marcusf

Joined 18 years ago

Karma
774
Submissions
227
Member since
Jun 16
hi, i'm marcus, vp engineering at spotify. swede, based in nyc. reach me at marcusf at spotify dot com or @marcusf most places.
View on Hacker News

Recent submissions

Comment · 4 months ago
Random, horrendous and indiscriminate killing!

[/joke]

Comment · 8 months ago
Egan is always dense. It's some mind bending physics/comp sci, but all cooked up in his brain so doesn't really apply to anything productive. I struggled with his books and his writing but toughened it out because I liked the concepts, but he's divisive.
Comment · 1 year ago
man, a comment that brings back memories. you and me both.
Comment · 2 years ago
An extremely layman answer is that most interesting innovation in parsing in relatively modern times has happened seems to be in the context of IDE's. I.e. incremental, high-performance parsing to support syntax highlighting, refactoring, etc. etc.

(I may be talking out of my ass here.)

Comment · 3 years ago
Parameters and training corpus size matter. Last year a new paper (Google "Chinchilla optimality") focused on compute-optimal LLMs found that we'd been under-training models -- i.e. you could wring more performance out of smaller models by training on more data. But (as far as I understand it - interested layman here) - for a given amount of data, model performance seems to scale more or less linearly with parameters.

Now, we could see another model architecture than the current reigning transformer architecture upend this (much work is ongoing on breaking the quadratic term in the transformer that computationally bounds its performance - an example is the Hyena paper that was published just the other day).

Biggest computer and most data wins is still the paradigm here.

Comment · 3 years ago
Eric, want to echo what folks are saying here. I stumbled on your blog in high school (ca 2003?) and you (and Raymond Chen) fueled so much of my passion for compilers and API design respectively, which dictated both my school choice and at least some career choices later. You were highly influential from afar :)
Comment · 5 years ago
Exciting
Comment · 8 years ago
Huge difference between a brand likey Disney able to pull off a streaming service and smaller producers. Smaller producers need demand, and for video demand = youtube.
Comment · 11 years ago
Comment · 11 years ago
Caveat that I might be completely off, but if, say, 10 bn people tried once a nanosecond since the inception of the universe, you'd still have only 10^10 * 2^86 ≈ 2^33 * 2^86 = 2^119 attempts, that still only cover's 2^-9 (i.e. 1/512th) of the total addressable 2^128 space, i.e. still fairly unlikely that you'll have hit that specific number.
Comment · 12 years ago
I think it's a mistake to compare Le Corbusier-style "areas for living" with modern urbanised zones. The big issue there is that – sure – there's highrises, but no urbanisation. Usually because they are either lacking commercial space on ground floors or the density is too low, on aggregate, or the areas are too spaced out to support vibrant commercial centers. Look at stockholm, you have city, greenery, suburb, greenery, suburb. No urban connection, not enough density.

I've lived in areas like this myself, and I agree they're not nice. However, I have to think it's not only locality to city center that makes central areas good, it's also that they are self sustaining burrows. There's ample housing, parks, jobs, retail, restaurants, bars, etc.

Comment · 12 years ago
Not to discard your comment, but wrt Stockholm: Build higher! Urbanize areas outside of the core inner city. Lots to do in planning and building to not create artificial social policy.
Comment · 12 years ago
Great to hear. And yeah, Henrik is teaching wizard. I'm sure he'll be happy to hear though :-)
Comment · 12 years ago
Hey! Thanks for the long question. I'll pass on your regards to Henrik :-)

> From what I understand, Spotify squads each focus on one area and each squad has very different members so it can stay autonomous. Is that right? What happens if sysadmin / developer / designer from squad X gets hit by a bus ? I'm actually talking about the bus factor [1] here, I hope you are all well :-)

It's not always easy of course. I think the notion of T/M-shaped people apply. E.g. if only one person in a squad can do iPhone development, better spend time training some of the other people to do it as well. It also creates collaboration opportunities, which are highly important to actually make a team work. Then of course there is a lot of fluidity between squads. If squad X needs design help but are out of a designer, squad Y might lend their assistance.

> How often do you change squads ? What about tribes ? The second video mentions "guild unconferences". What is that ? Can squads work remotely ?

It varies. Some people have been in the same squad for two years, others are in new ones every six months. And generally, you change squads and if a tribe move has to happen, that'll happen as part of that. Squads are generally co-located though, so not many squads are remote-composed. A guild unconference is simply an unconference (http://en.wikipedia.org/wiki/Unconference) on a certain area, e.g. Machine Learning, Web, Mobile, Backend etc. So all the people who are interested in that get together for a day and debate the future of that area.

> How does code review work at Spotify ? For the last 2 weeks, we've been using pull requests on Github, which I've found to be a very good way of doing code review. Since the reviewer is the one to merge, eventually his/her name is on the commit too, which in my case makes me focus even more before hitting the "Merge" button. Merging creates an explicit merge commit, which makes reverting things easy if needed. And discussion in the comments allow for efficient, asynchronous discussion.

We use GitHub as well. Roughly the same model.

> The video talks about how important trusting employees is to Spotify. That makes me wonder: do employees sign such things as non disclosure or non compete agreements ? what do you (or what does Spotify) think of such agreement ?

We think trust is highly important, and embodied in what we share internally and how open we generally are. Not sure I can comment on the legal aspects of that though.

> For the last few months, I've been reading the Groove blog [2]. Recently, Alex, Groove's CEO, talked about how much time he was spending talking to customers. How much do you (devs, sysadmins, marketers, designers, etc) communicate with users ?

Never enough :-) We do spend a lot of time with user research, both structured via our research team but also Starbucks testing, when a few devs go down to the local coffee shop and test features. Then we have community outreach teams that keep us honest and makes sure to push the customer voice inside the company. Also, a ton of engineers hang around on e.g. /r/reddit and asks questions. And when users blog about or voice their concerns, it does make the round on internal lists.

> How do gradual rollouts work ? Do you use a third party service for that ? Would love to learn more.

Mostly custom built, and it varies a bit between the backend and the front end. It's all the usual jazz though, deploying per machine or percentages of users or localized to markets etc.

> Thanks again.

Hope I at least answered some of the questions.

Comment · 12 years ago
Sometimes. But as a general principle, we ship on quality, not time.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton