hfbff
Joined 4 years ago
Joined 4 years ago
``` pyarrow.csv.read_csv(input_file, read_options=None, parse_options=None, convert_options=None, MemoryPool memory_pool=None) ```
You can then pass a `ReadOptions`[1] object if needed.
For example:
``` read_options = csv.ReadOptions( column_names=["animals", "n_legs", "entry"], skip_rows=1) csv.read_csv(io.BytesIO(s.encode()), read_options=read_options) ```
You can see how ReadOptions is written on this link [2]. It's interesting they use a `cdef class` from `Cython` for this.
This doesn't solve all issues (the ReadOptions object and the others will inevitably have a bunch of default arguments) but I do think it's safer and it's easier to have a mental map of the things you need to decide and what's decided for you.
[0] https://arrow.apache.org/docs/python/generated/pyarrow.csv.r... [1] https://arrow.apache.org/docs/python/generated/pyarrow.csv.R... [2] https://github.com/apache/arrow/blob/master/python/pyarrow/_...
Is the author assuming you're either from the US or European if you're reading the blog?
Also: I'd like to ask you a few questions on Latam remote work. My email is in my About if you have the time!
I don't see why this would be true. If you have evidence of some strong argument on why this would be true, I'd like to hear them.
As an anecdote, I work with young people (x<25) that don't seem to be worse at recalling facts than the older generation. The bright/geeky ones grew up reading up wikipedia and, in fact, have a wider grasp of facts/stories than the older generation (in my experience)
Before spell checkers, having good spelling was relatively difficult and it allowed employers/teachers/etc to separate the "good" people from the "bad". After spell checkers became ubiquitous (unless you have to handwrite!), having good spelling became the norm and the floor becomes much higher. A document with bad spelling means the person doesn't know of spell checkers (a sign that the person isn't computer savvy enough?) Or doesn't care enough.
Did spell checkers reduce the language capacity of students? Maybe they did start putting less attention into spelling, but I would argue it's ok because now we have more assistance. If you really want to test their spelling, you can always do a handwritten, in class quiz.
ChatGPT and the like may be different because they are written the whole thing, right? Well, kind of. You still need to give the prompt to express what you want to say. You still need to correct stuff and exercise judgment to see if the style in this paragraph is ok, if the facts stated over in that other paragraphs are ok. Besides, you still need to learn how to write because of the in class quiz next week.
I very much like Emily Dickinson, why? (What's your favorite piece of poetry?)
(Also, general intelligence is not usually synonymous with self awareness in the literature. You might want to argue that, but it's, I think, a minority opinion)
The other issue is that the incentives aren't necessarily aligned. They don't get payed to share their code or to make their code reusable. The code is used to publish one or a couple of paper and then thrown away. Maybe someone else will reuse it in the future but the original author doesn't necessarily gain much from that
I think it's related with the "substantive elaboration" test with regards to copyright (sorry I can't remember the proper term). If I just copy a scene from your movie, you can probably sue me. If I take some elements from it, but do my own thing so that it read more like a parody/comment / meta-comment, then it's ok.
Is AI just parroting back stuff or is it creating new things? A few years ago, I would have said it's just parroting. With the current models I think we are midway (it will depend on the propmt too!). In a couple of years my bet is that we'll be clearly on the "creating new thinfs territory".
cd_1901 is my username
proton.me is the server