aanfhn

First job out of school had me using Hipchat, so when I finally got a job that had Slack, it felt like bloated Hipchat. Didn't think about Hipchat for years until this post and I miss all the emotes/GIFs we used on it.

  Location:            Boston
  Remote:              Yes, also open to local, hybrid roles
  Willing to relocate: No

  Technologies:
    * Python, SQL, R, Spark, Airflow, Alteryx, Redshift
    * Tableau, PowerBI
    * AWS, GCP, Azure

  Résumé/CV:        Email Me
  Email:            see my profile
  LinkedIn:         https://www.linkedin.com/in/39fjw81n/

About me: I'm currently a manager on a data team with experience working on projects building end-to-end data products, so anything from data pipelines to dashboards. Have been in a niche industry but looking for an organization and team that is more tech-oriented. Happy to consider roles along the lines of data architect, manager of data engineering, manager of analytics, and senior data engineer!

What are people's and the market take on Starburst? I haven't kept up with databases and the general market, but recently heard about them. Is there a sizeable demand and market for them? Any other big players to watch for?

Yep, that's what I've seen across my area (Boston) and friends' communities. I appreciate the writer mentioning that there are many megachurches that have gone virtual. I admittedly still find it weird to have service online, so it's going to take me some time to get used to it.

It was difficult for most churches figuring out the technical difficulties at first, but things have been smooth the past two weeks.

Also, if anyone has ever been interested in checking out a church, this is probably the best time to do it - you can do it from the comfort of your pajamas, and tons of churches have virtual services. Happy to share a few well-known churches/pastors if anyone is interested.

Been eyeing data engineering on BCG Gamma for a while now but am admittedly confused as to how that role fits at Gamma, which seems heavier on the DS side. Any chance you could describe the profile of a <senior> data engineer the group is looking for? I've also seen data engineering roles for Gamma only on the general BCG jobs site but never on Gamma's jobs site.

Does anyone mind sharing how IP addresses are allocated and bought in the first place? Like who did GE buy it from if it wasn't another company?

Is Gamma 100% data scientists? Correct me if I'm wrong - there aren't data engineers on Gamme, right?

Loading a single, large file into Redshift? I get the impression the author has a passing knowledge of Redshift at least. I'm not too familiar with BigQuery, but for Redshift, loading files in batches of total slices in the cluster is the recommended approach. No wonder it took 9+ hours to load that file. And the author also doesn't mention distributing the data on a particular column. I wonder if he did random distribution.

And his problem with the field delimiter really shows lack of experience; of course you can't use a multi-length field delimiter. I've never seen anyone use a comma+space for a delimiter. That file could probably be about 75% of the original file size if he re-created it with just the comma as the field delimiter.

Sorry to bash on the author - don't mean to sound harsh but a lot of people are trying to do benchmarks but with minimal context and whatnot