The two hour interview I did for this piece was a nice culmination of the last 4 years I’ve spent thinking about what makes the New York tech scene different and special. In retrospect editing it down to 7 seconds was even better. In the words of the mayor, “NYC is where the best and brightest come to shine”.
This February, Amazon again asserted its influence when it pulled nearly 5,000 titles by distributor Independent Publishers Group from its Kindle e-book store. Amazon wanted better terms, and IPG said “no.” Amazon.com trying to wring deep discounts from publishers
A thought, as Amazon’s and the publisers’ relationship gets more bruising seems like there is room to be the company listing all the books in print, and where they’re available for purchase. Could be classically disruptive business (in that it will always be tiny, but with the chance to implode something larger).
Aggregating information from a diverse set of sources all over the world is the sort of thing which even 10 years ago was hard, and is now straightforward as long as you have the right motivational loops in place.
We moved (back) to New York July 2008. We drove, though I only made it half way across the country before I had to have Jasmine drop me off at Austin-Bergstrom International Airport because I suddenly had to get back to work.
That first year we were living in a traditional Williamsburg apartment: a zoned light industrial, lightly converted for human habitation loft space (above the Roebling Tea Room in that big brick building). And it was a hot, and sticky Summer. Not like this last Summer. It was a lie awake at night sweating, slightly fevered thoughts blending with the sounds of a city that wasn’t sleeping coming through the open windows. It wasn’t an easy transition that Summer. It was amazing, but not easy. And in circumstances like that you find comfort in odd places.
And one of those places was my laundromat. Really. You see it felt like New York. It was big. It was full of a people who weren’t like me. It was open 24 hours. This was a laundromat for New York. And sitting in the laundromat, at 3am, in shorts and sandals, watching a world swirl by I felt like a New Yorker. I felt like I’d broken free from the normal rules, and I was living a new negotiated existence in a city of possibility.
So odd as it is, I’m going to miss my laundromat. We don’t live around the corner anymore. And the wave of gentrification of which we’re a part has swept us along and left us with our own washer/dryer. The bagel store on the corner is gone as well, rumored to be a Starbucks, so there was never going to be another hot sticky night of laundry and bialy anyway. And I’ll miss it.
“… because as soon as we started [pinning] for you it really became our civilization.” – omgrobot10
Saturday Jasmine and I put together omgrobot10, which is really the “Hello, world” of a particular branch of New Aesthetic. It motivated/exercised some code, and it amused us. But something unexpected also fell out of it.
“culture is the interference of two programs being executed in information proximity”
omgrobot10 is continuously repeating a very simple rule set. Spontaneity is added entirely by it’s interactions with people. As expected. What was unexpected was how it would interact with other actors also continuously repeating a very simple rule set. And no, that isn’t a dig at Pinterest users.
You see what I found almost immediately was, “TheDress”.
“OMG!!! I love this dress! I bought it for a cruise last year, and got many many compliments.”
In the first 24 hours omgrobot10 re-pinned TheDress from 6 different accounts, all for whom it was a fond memory of last year’s cruise. Since then omgrobot10 has re-pinned TheDress 17 times from 17 difference accounts.
What’s interesting is the TheDress also works fine in the noisy and spontaneous space that is the “Pinterest > Everything” page largely populated by humans. But it’s simple expectations clash with the simple expectations of omgrobot10.
There is also DeskOrganizer, who follows a similar agenda as TheDress, a tireless activist for a particular product that it has become fixated with it. But DeskOrganizer seems more content to be patient, play the long game, TheDress wants to get it’s message out now, at least ombrobot10 has only encountered it 4 times.
But both of them have formed a mutually beneficial relationship with omgrobot10. The interference of their programs creating a robotic culture of what looks, from the outside human perspective (and therefore deeply uninformed) , as mutual aid.
See also, the ethnography of robots.
I’m going to be at Kick, Saturday morning, 9:30am
I’m going to be at Frank, at 10am sharp Sunday morning as they don’t take brunch reservations
I’ll be at Made in NY, at the Cedar Room Sunday night, because Etsy’s presence at SxSW this year is low-key/unofficial like.
I’ll be at “New Aesthetic” 9:30 Monday morning, because “Maps, Books, and Spimes” was one of my all time favorite SxSW talks, and this looks like it will be at least as much fun. And I want to see a drone.
I’ll be at World Changing 2.0 at 12:30 on Tuesday because Cameron Sinclair’s “Open Architecture Challenge: Revisioning Decommisioned Military Facilities” was fucking awesome, and I’m looking forward to more.
I’ll be at Bruce Sterling 5pm Tuesday, because I once taught a class on global politics using the text of “Islands in the Net”, and it’s Bruce Sterling!
I’ll be selling gold on black “Just Ship” shirts, with any luck using a prototype Etsy mobile payment system. So if you’ve wanted a “Just Ship” shirt, this is your opportunity.
I might make a pilgrimage to Opal Divine’s as the thing I missed most bitterly at SxSW last year was the indie “Data Drinks”, and I strongly encourage people to organize and publicize “[important technical topic here] Drinks”, rather then trying to communicate then on a panel. (e.g. y’all “Decentralized Web” and “SSO” folks ought to plan something, somewhere in the afternoon with “Mexican Martinis”)
I’m hoping to have some success booking small to medium sized group meals, mixed results so far.
Beyond that I’ll be around hoping to meet great people.
What are your plans?
That history is written by the winners is at least in part an unfortunate artifact of poor storage and retrieval technologies, and a poor backup regime.
I love Photojojo’s TimeCapsule. TwitShift is delightful. And I’m sure in time I’ll come to feel the same way about TimeHop. Like many people of my generation I’ve spent most of my “adult” life bouncing between jobs, cities, countries, etc. At one point Jasmine and I calculated that between the two of us we’d moved 14 times in the previous 10 years. Outsourcing memory to silicon in a life that largely lacks useful time signifiers is immensely helpful. But I’m also a bit uncomfortable with how much I like these services. Besides a certain puritan work ethic guilt, they’re deeply narcissistic.
In particular two features bother me:
- they present the world devoid of the people I was sharing it with at the time
- they’re largely constrained to minor modes of participation, e.g. tweets and check-ins.
Rod tweeted out a link yesterday to his 8 years old blog post about Flickr launching, it’s amazing:
It has the standard Friendster-esque friend-browsing capabilities, plus Tribe’s, erm, tribes. So far, so orkut. But what’s super-neato is what’s on top.
First off, you can gradate your friendships. The levels of Acquaintance, Friend, Best Buddy and Soulmate are all available to make the politics of friendship even more precarious. (There’s also a planned-for-the-future level called Enemy which is as-yet unattainable)
Then there’s the funky flash chat-app: an multi-window IRC-lite affair with an emphasis on picture sharing.
This is not the Flickr most people think of, or even that most people remember existed. The Flickr of today is many iterations of lessons learned later, and perfectly binary nature of the digital world largely hides that honing effort, except in the remembrances of those who were there 8 years ago.
I’d like that as a service. Send me what my friends were writing 8 years ago today-ish. Their long form work. We could start with blogs, tease out books and papers later, eventually troll The Archive for projects they were launching.
Over coffee this morning I thought about how you’d do it just for blogs. And I decided I wasn’t going to try to build it this morning as it clearly was going to take longer then 20 minutes.
My first thought was using RSS. It has fairly well understood semantics for permalink and publish date extraction. But you’d really only be able to start at this moment in time, not have the last decade plus of historical record.
You could build a time machine and go back and make sure either good semantic markup/microformats got adopted or that the RSS pagination specs became the norm. But if you’ve got a time machine fixing those issues aren’t even on my top 10 list for you.
Continuing on the time machine line of thought, one of the old aggregators, like Bloglines could offer the service assuming IAC still has the archives around. (oh wait, looks like they sold Bloglines to MerchantCircle, huh)
Not sure how interesting/practical the above are.
So then I started thinking about all the folks over the years who built blog crawlers with logic for doing date and permalink extraction, and even summarization. Some quick Googling turned up nothing useful in terms of documented techniques or code. But I figure someone has just got to have some code lying around, yes?
Could you please build this? (or barring that, send pointers on papers/code/etc)
photo by sweetfineday
In our 2012, “Most Williamsburg” contest, Mike White has taken an early lead with his bacon infused pour over technique.
“This is how I use my Chemex filters. ”
There’s a hilarious answer to the question Why are software development task estimations regularly off by a factor of 2-3? floating around now. Hilarious, deeply knowing, but not terrible accurate or actionable.
But buried in the comments was this gem from Neil K, which I’m going to quote, in it’s entirety, for truth (Neil has, after all, seen more sausage getting made at more of the places whose tools you use then nearly anyone):
This is really good, but if I can offer a suggestion — the analogy could be even more apt with a slight shift. Currently it only shows how people go wrong when they develop software in a naive way — by starting at the beginning, and coding each step to final quality, in order. The story, as written now, makes it look like writing software is just an impossible slog and nobody can do it.
The truth is, software is research. It’s a matter of discovering the solution, not plodding through it. This is implicit in your story, because they keep encountering unexpected problems. But let’s make it explicit.
Imagine, instead, that our intrepid pair is charged with mapping the coastline of California from SF to LA. Mapping is more like software development because it involves discovery, and getting things right at multiple “points”.
The naive mappers start off from SF and it all fails exactly as you outline. A more clever pair of mappers instead decide to hire a boat, and map just a few points on the coastline precisely, just to get a rough estimate, and to survey the coastline for the tricky places. Then they know where to apply their efforts — an intern can be hired to pace out some of the easy bits, and a team of well-equipped hikers can be brought in to handle the hard parts.
They can even stop when they have a map that is just good enough.
Regarding Twitter’s recent changes:
Starting today, we give ourselves the ability to reactively withhold content from users in a specific country — while keeping it available in the rest of the world. We have also built in a way to communicate transparently to users when content is withheld, and why.
I mostly agree with Simon’s excellent post on his experience of adding this feature Flickr, and I18N in the broader Yahoo context, summarized as:
(1) Online companies have (and should have) little to no power to alter a country’s laws. (2) Online companies have an obligation to follow the law in places where they do business. (3) The revolution will not be Twitter-fied (4) The internet transcends borders; most laws do not. (5) Assumptions of malice are generally misguided, moreso in the face of opposing evidence
I’m also deeply appreciative that he took the time to write it.
I also mostly agree with Blaine’s related assertion
Twitter is a corporation, not a radical or even progressive platform. The internet, though, is.
There’s a topic I’m deeply conflicted about in there, and I’m not even sure what it is.
I’m not remotely conflicted that the Internet’s unthinking freak out is counter productive and poorly informed. (probably due to so much of what passes for dialogue these days being conducted in 140 characters and proxy gossip rags)
Anyone who followed or engaged with the recent SOPA/PIPA protest hopefully left it with an appreciation for the dangers inherent in allowing companies to craft legislation
Creates for me a worrying abrogation of our rights as moral individuals working within a corporate system to improve the world.
When Google went into China refusing to adapt, and later pulled out because they refused to adapt to the limits of that market’s law was that them being the MPAA forcing their corporate vision on unsuspecting foreign citizens or was that them taking a principled stand for a better world? (and that they pulled out also because they got hacked, and because Baidu was probably kicking their ass somewhat undermines my point, but there are so few examples to point to at scale we’ll take this one. If you’ve got a better one, love to hear about it)
I was never comfortable with the line we walked at Flickr, it felt like we accepted too many restrictions as “the price of doing business”, but in a resource constrained tiny organization inside a much larger corporate behemoth there is a moral fig leaf to hide behind. Twitter has significantly less to hide behind. It’s a line that Etsy walks as well. We don’t, for example, allow you to sell vintage Nazi paraphernalia in any jurisdiction.
Additionally Simon, and Heather, and others who actively shaped our international policy were:
- Transparent with our community that we were doing it
- Transparent when content was being hidden and why (for country restrictions or DMCA or whatnot).
If you’re going to do per country filtering, I can’t think of two better principles to put in place, and these are the principles that Twitter mentioned in their blog post.
Fundamentally this is one of the tensions in centralizing all your communications into a small handful of privately held, globally scaled, profit motivated corporations, and then centralizing people into semi-archaic, geo-political niche regulated markets we like to call countries.
(In the misattributed, misquoted, and then deeply munged words of Mark Twain, “I’m sorry, if I was clearer on what I believed, I would have written less.”)
- (aka the fuzzies, or the blacked out images, transparency around this wasn’t perfect, and didn’t arrive all at once. Iteration was needed.)
Stumbling onto this Fab.com 2011 retrospective, reminded me of something that’s been puzzling me. While I knew a bunch of great folks going to work for Fab.com, including Lori Dorn and Beth Ferreira, I didn’t know any of their geeks. Which is odd in a small tech scene like New York.
Turns out the geeks are True Sparrow Systems, they appear to be a boutique Rails shop, they’re based in Pune, India, and described as co-founders. And Jason Goldberg did his last company, socialmedian, with them as well.
Last March Jasmine started talking to me about Pinterest in terms that made me pay attention. Since then I’ve been keeping an eye on it. A few weeks ago I decided to “cheat” my way into participation by writing a quick script to sync my Etsy favorites to a board.
Per request, I just pushed my PHP library for the unofficial Pinterest API up to Github. It’s a simple thing, more suitable for forking then using as is, and with some serious gaps where I simply haven’t had the time to find (assuming they exist) API methods for simulating the “pinmarklet” (as opposed to uploading), and for backing up pins.
sometim.es(I was convinced to keep this one)
Will you do something cool with it? Are we friends? They’re your for the asking.
Also there really ought to be a site that facilitates offering up domain names you aren’t using to friends with a bit more structure then Twitter/blogging.
But I do like playing with new sites and that means playing with sites that haven’t opened up an API, yet. It’s funny I keep getting into conversations with folks about, “We’re not sure how to open an API” or “We’ve got an API, but we think we need to rebuild it (and/or outsource maintenance of it to a 3rd party) before we make it public.” For those folks, please see flamework-api, an implementation of the Flickr “API framework” for how easy it can be, and then get over your timidity! But my favorite variant on this is, “Well we have an API for the iPhone app, but it isn’t ready yet for public.” Because that means there is an API, and you can use it.
Some quick notes on reverse engineering an API from an iPhone (mostly because I had to scrape all this back out of my lizard brain this week, and while it’s straightforward, there are a few step)
- Grab a proxy, I use Charles, but Burp works just as well and is free.
- On a wifi network, fire up the proxy and enable SSL proxying.
- Connect to a secure site with a browser via the proxy. (Charles will setup proxying for Firefox automatically)
- Using Firefox, drill into Page Info > Security > View Certificate > Details and export the CA certificate, which will be the intermediate proxy’s root cert. (e.g. with Charles it will be CharlesProxySSLProxying.cer) (YMMV with different proxies, and different browsers)
- Upload the root cert somewhere you can hit with mobile Safari from your phone
- Browse there with your phone, and add the cert.
- Throw your phone into “Airplane Mode”, re-enable wifi, connect to the same network your proxy is running on, in the “Choose a Network” menu, drill down and setup Manual proxying pointing at your laptops IP address, and port 8888 if you’re running Charles or 8080 if you’re running Burp (or whatever else your proxy is running at)
- Fire up the iPhone app with the API you’re interested in, and sit back and watch the bits flow.
(Reading over this again this morning I noticed I just assumed SSL, my data points suggest that’s a reasonable assumption both as SSL is easy, and as FBOAuth becomes more common, but obviously if the API you’re looking at isn’t running over SSL, skip steps 2-7.)
It wasn’t really until we were leaving London last week that I figured out that I should have installed the London Cycle app, a 3rd party app that scrapes up-to-the-minute information about availability of Barclays bikes (aka “Boris bikes”), and provides maps and routing.
Nearly every Londoner (or sometimes Londoner) we met had it installed, but none of the varied insipid “top 25 iPhone apps for London” style SEO bait blog posts mentioned anything like it.
So I’m curious, what applications do you know to navigate your city and get the most out of it? They don’t have to be city specific, I’m just curious what the apps you whip out when exploring, or getting to work, or meeting friends. What’s useful? (and where do you live)
We’re reaching a point where the our cityscapes are almost intractable without augmentation and I know that keying up proper augmentations will become a key piece of my next round of urban travel.
In New York I tend to use only a small set of city specific software (much to my chagrin), and mostly rely on big generic apps (in which NYC tends to be well represented)
To navigate New York I use:
I’m excited about anything that makes reading more social. I’m also excited about anything that makes the data I collect on my Kindle more accessible. (it’s a surprisingly locked down platform)
And kindle.amazon.com is a nice step forward. But it’s clear that Amazon does not build social software for a living because there are a handful of things they’re doing shockingly wrong, and the one that’s bugging me this morning is:
You never ever ever broadcast deletes, or privacy changes that move from more public to more private. You never send people an email “By the way Kellan stopped following you, because you suck” and you never broadcast in an activity stream, “Kellan’s tweet, ‘I’m so drunk I’m skipping work tomorrow’, has been deleted.”
This second example is what the Kindle site is doing when they broadcast that you’ve stopped sharing notes from a book or deleted it from your book list. That’s so broken it’s almost breath taking.
update: see also, for something else not quite right. People are hard, let’s go shopping.
About a year ago I did some deep diving into kindle.amazon.com trying to find a good programatic way to extract my data. It was a nightmare of client side JS templates, and general hatred of everything that was good about the Web.
In the last few months the Kindle site has gotten better. It uses real HTML, and has a semi-functioning concept of profiles, and contacts. But it still isn’t really what I want. But I’m busier then I was a year ago, and even given relatively sane HTML, I don’t feel like writing a scraper for something that ought to have an API.
But Fred’s post from this morning on “Sharing My Kindle Highlights” got me thinking that maybe I had been thinking about it wrong. Maybe I don’t need programmatic access to all of them, maybe I just wanted a bookmarklet to post selected hilights to Tumblr.
And I’ve got some bookmarklet code lying around, so I beat on it a bit, and was able to whip out Booknotes, alpha, a bookmarklet for posting from your Kindle hilights page to Tumblr.
I’m pulling the ASIN out of the “Read more at location X” links, and feeding that into the “Product Advertising API”, so while I’m only posting the title, link, and authors at the moment (because I couldn’t figure out how to pass rich markup to Tumblr’s share widget), there is a ton more metadata (like book covers) that could be included.
At the moment it’s only been tested on Chrome latest and on OS X Lion for a handful of my own highlights as building has already taken 200% of the 2 hours I allotted myself. (though part of that was getting XCode and Brew and a text editor installed on the new laptop)
So yeah, Booknotes, alpha.
Just a quick follow up. Got a ton of good feedback on last weekends “Slow News” post, in the comments on that post, and over at G+.
Some of my favorite comments where from Mike Migurski. Apparently his Google Plus account has been deleted. To say this tarnishes G+ for me is putting it mildly.
But to summarize the feedback which hasn’t been expunged, folks recommended:
- the New Yorker
- the Economist
- the Christian Science Monitor
as organizations who preform some of the slow news function.
We get the Economist, but I find it more useful for it’s brief overviews then it’s in-depth articles. (I generally find their bias is directly proportional to the length of the articles), and for some reason I’ve never been engaged by the New Yorker, I’m tempted to try it again but their digital pricing is a turn off.
Additionally I found Jerome’s point that a crowd funded news organization is particularly susceptible to being captured by lobbyist and special interests interesting. I’m not convinced that this is different then the situation we currently have with our media, but it does point to a membership organization as a model rather then a pure Kickstarter model.
August 2, 2011⇒ Mapnificent – New York.
How far I can get from my house, in 20 minutes, on public transportation. Nicely done. (via swissmiss)0. (Aside )
July 31, 2011⇒ Sci-Fi Hi-Fi — Twitter, Instagram, and the Journalistic Impulse.
“I’ve never been one to keep a journal (much to my chagrin as an inveterate collector of fancy stationery), but, silly as it may sound, Twitter made me feel like a field correspondent—our man on the Rio Grande—and thus encouraged me to think like a journalist.” – Buzz.0. (Aside )
Last weekend everywhere I went people wanted to talk about the tragedy in Norway. I didn’t know much about it, just the bones of the story, but I found, as I always do, our fascination with it, perverse, and a bit grotesque.
I liked to think that in the best possible world, broadcasting the blow by blow coverage of distant tragedy connects us all with our shared humanity. But mostly it just seems ghoulish, and to borrow an old slogan, it’s like voting — it just encourages the bastards.
What I really want is someone doing in-depth, well researched and written coverage of news events 1-4 weeks after the event. When all the details are known, and sifted, and analyzed.
Not all stories lend themselves to this. That our government is derelict in its duty and will be defaulting this week isn’t a story that can wait weeks. But even a few days to pull together a decent body of reporting/facts/graphs/analysis rather than rehashed he-said-she-said-chest-beating-editorial would be nice.
Thinking a Kickstarter-esque funding model would work really well — pledge your interest in an ongoing story in real time giving the news organization a heads up that they should be paying attention and starting to research, if enough folks show interest, the story gets written. Won’t cover all types of reporting, but it certainly would be a hell of lot better then 90% of what we’ve got. (and give me a page where I can advertise my interests as a dodge to having to talk about the ridiculous pop news hype cycle, “Yeah, I’ve pledged to read about that in another 2 weeks, check out my Slow News page, let’s discuss it in depth, then, shall we?”)