timothycrosley

Are you using any custom settings?

FWIW, I wrote isort, but am seriously considering migrating my projects to use Ruff. Long term I think the design is just better over the variety of tools we use within the Python ecosystem today. The fact we have a plethora of projects that are meant to run per a commit with each one reparsing the AST independently, and often using a different approach to do so, just feels untenable long term to me.

I personally think avoiding getting infected ever, just is so impractical as to not lay out as an option. As evidence more and more is showing both infected and vaccinated people are likely to spread the infection (even if they don't get symptoms) as soon as 3 months after the acquired "immunity". Combined with how infectious delta is, this third choice of never getting infected just feels disingenuous.

This is complete nonsense. If anything VAERS would be over-reported, the people who are most against vaccination, blast it so often I see it in my facebook feed more often than advertisements. Anyone can add to VAERS, and I'm sure with all the antivaxx advertisement of it, they DO. Not to mention that doctors are required to, and report even unrelated deaths that happen right after vaccination. Meanwhile the reporting standards for covid, are the same as flu, nothing's changed there just a bunch of people grasping at straws, toward what goal I can't imagine.

While we are sharing meaningless anecdotes, almost everyone I know (since I live in Seattle) has been vaccinated. No one has reported any issues, a couple have since successfully had a child. None have even gotten a breakthrough infection of covid. Among friends I know from back east, who haven't gotten vaccinated, one had just turned 30, only health issue was obesity. He died. One was 35, best shape of any of my friends, was in ICU for 7 days with double pneumonia. And one miscarriage.

But hey, the good thing is, we also have data. And the data, shows no correlation between vaccination and these problems you're referring to, and yet a VERY HIGH correlation (and some good reasons to say causation) between getting covid and having these issues.

The problem with examples like this is that simple FileIO operations are optimized across all languages. It would likely have similar speed in very naive unoptimized Python.

Here is an example:

Given `create_csv.py`:

  with open("output.csv", "w") as csv_file:
    for i in range(1_000_001):
      csv_file.write(",".join([str(i)] * 100))  # creating 100 columns per entry out of a million
      csv_file.write("\n")

and `search_csv.py`:

  import sys
    
  for row in open("output.csv"):
    if "1000000" in row.split(","):
      print(row)
      break
  else: 
    sys.exit("row 1 million not found!")

With the first script creating a 1 million line csv with each row containing 100 columns, and the second one being a worse case search (has to make it all the way to last row, has to search every column). The performance is better than what you mentioned on commodity hardware, very unoptimized Python code, and default Python3 installation:

time python3 create_csv.py

  real    0m3.267s
  user    0m2.589s
  sys     0m0.608s

time python3 search_csv.py

1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000

  real    0m6.132s
  user    0m5.954s
  sys     0m0.162s

Can confirm that I would be happy to collaborate on this project, it looks really cool!

Reminder that we officially live in a post Python 2.x world. I think at this point the correct answer to the awkwardness of threads is to use async.

I'm a principal level software engineer with experience providing strong technical direction for development teams. I have extensive experience designing and developing complex web applications and large scale data processing pipelines. Working with teams to create and maintain both low and high-level documentation while working with customers to define requirements. A knack for simplifying and organizing the complex, enabling teams to scale. Core developer behind many successful Open Source projects. I'm always excited to learn more and to tackle new problems.

  Location: Seattle, WA, USA
  Remote: Yes
  Willing to relocate: No
  Technologies/Languages: Python, JavaScript, C/C++, Ruby, YAML, TOML, HTML, CSS, Sass, LESS.
  Technologies/Frameworks: Spark, Hive, Django, Compass, Zope, QT, PySide, GTK, TK, MEAN, Angular, hug, flask.
  Technologies/Databases and Caches: Hadoop, Oracle, PostgreSQL, MYSQL, MongoDB, Redis, Memcache, ElasticSearch, Solr, Google’s Cloud Datastore.
  Resume/CV: github.com/timothycrosley, timothycrosley.com
  Email: [email protected]