{ "attachments": [], "comments_archived": true, "date": "2010-07-05T23:00:56.000Z", "layout": "post", "tags": [ "webdev", "firefox", "google", "python", "entries", "mozilla", "sync", "appengine" ], "title": "Firefox Sync server on Google App Engine", "wordpress_id": 1937, "wordpress_slug": "firefox-sync-server-on-google-app-engine", "wordpress_url": "http://decafbad.com/blog/?p=1937", "year": "2010", "month": "07", "day": "05", "isDir": true, "slug": "firefox-sync-server-on-google-app-engine", "type": "entry", "postName": "2010-07-05-firefox-sync-server-on-google-app-engine", "html": "

TL;DR: I built an implementation of the Firefox Sync server API for Google App Engine.

\n

\n

To celebrate Independence Day, I figured I might take a shot at liberating Firefox Sync from the tyranny of Mozilla's servers.

\n

Thus, over the past few days, I've built a sync server using the 1.0 Sync API, hosted on Google App Engine.

\n

I lied about the tyranny thing, though—I just wanted to say something clever about the holiday. In reality, with respect to Firefox Sync, Mozilla has done all of the following:

\n
    \n
  1. Published the Sync API spec;
    2. \n
  2. Released the source code for the server used in-house;
    3. \n
  3. Explicitly included the option to use a custom server when setting up sync in the browser.
    4. \n
\n

This means that, although Mozilla offers servers to go along with Firefox Sync, you're totally free to take your data elsewhere. Since your sync data is encrypted and practically opaque to the server, there's no direct profit for Mozilla in offering free sync hosting—not even through any clandestine data mining for devious purposes. It's just that sync makes Firefox a better browser, and somebody has to run some servers to make it work.

\n

So, there's every incentive to make it easy for you to switch sync providers and stop freeloading on Mozilla's servers. Building a server on Google App Engine means I can freeload on Google's servers!

\n

I kid, of course. No one's really complaining about freeloaders, and App Engine has quotas in place to head off any serious mooching—which is why I'm not telling you where to find my sync server deployed on Google App Engine, by the way.

\n

No, I did this because:

\n\n

There are, of course, a number of bugs in this server. But, it seems to be working between a number of machines and browser profiles I have at home. Things are really in need of optimization, it suffers from my inexperience with App Engine, and I keep running into those aforementioned App Engine resource limits—especially when updating or deleting large numbers of items (ie. 1000's to 10000's of items).

\n

Pull requests and issue reports on GitHub are welcome!

\n

A next step I'd like to take with this thing is to revisit another old friend, the desktop web app server. (Also known as the desktop website.) It seems to me that it would be interesting to scale this server down to a household appliance—say, just for use by my wife and I.

\n

I'd be especially happy if the work I'm doing for a Google-hosted app could be self-hosted at home. Seeing as the development environment for App Engine runs on my laptop, I'm willing to bet I can hack the whole shebang into a simple, special-purpose app to download and double-click on a home desktop PC for use as your sync hub.

\n

Anyway, check it out and let me know what you think.

\n

Archived Comments

\n\n\n\n
\n\n\n", "body": "TL;DR: [I built an implementation][impl] of the [Firefox Sync server API][api10] for [Google App Engine][appengine].\r\n\r\n[impl]: http://github.com/lmorchard/firefox-sync-appengine\r\n[api10]: https://wiki.mozilla.org/Labs/Weave/Sync/1.0/API\r\n[appengine]: http://appengine.google.com/\r\n\r\n\r\n\r\nTo celebrate [Independence Day][july4], I figured I might take a shot at liberating [Firefox Sync][sync] from the tyranny of [Mozilla's servers][servers]. \r\n\r\nThus, over the past few days, I've [built a sync server][impl] using the [1.0 Sync API][api10], hosted on [Google App Engine][appengine].\r\n\r\nI lied about the *tyranny* thing, though—I just wanted to say something clever about the holiday. In reality, with respect to [Firefox Sync][sync], Mozilla has done all of the following:\r\n\r\n1. Published [the Sync API spec][api10];\r\n2. Released [the source code for the server used in-house][sync-server];\r\n3. Explicitly included the option to use a custom server when setting up sync in the browser.\r\n\r\nThis means that, although Mozilla offers servers to go along with [Firefox Sync][sync], you're totally free to take your data elsewhere. Since your sync data is encrypted and practically opaque to the server, there's no direct profit for Mozilla in offering free sync hosting—not even through any clandestine data mining for devious purposes. It's just that sync makes Firefox a better browser, and *somebody* has to run some servers to make it work.\r\n\r\nSo, there's every incentive to make it easy for you to switch sync providers and *stop freeloading* on Mozilla's servers. Building a server on [Google App Engine][appengine] means I can freeload on *Google's* servers!\r\n\r\nI kid, of course. No one's really complaining about freeloaders, and App Engine has quotas in place to head off any serious mooching—which is why I'm not telling you where to find *my* sync server deployed on Google App Engine, by the way. \r\n\r\nNo, I did this because:\r\n\r\n* Firefox Sync and Google App Engine are interesting and important technologies;\r\n* I've already done a bit of work on the PHP-based Firefox Sync server at Mozilla;\r\n* I really wanted to take a break from PHP and spend some time with my old friend Python.\r\n\r\nThere are, of course, a number of bugs in this server. But, it seems to be working between a number of machines and browser profiles I have at home. Things are really in need of optimization, it suffers from my inexperience with App Engine, and I keep running into those aforementioned App Engine resource limits—especially when updating or deleting large numbers of items (ie. 1000's to 10000's of items).\r\n\r\n[*Pull requests and issue reports on GitHub are welcome!*][impl]\r\n\r\nA next step I'd like to take with this thing is to revisit another old friend, the [desktop web app server][desktopserver]. (Also known as the [desktop website][dw].) It seems to me that it would be interesting to scale this server down to a household appliance—say, just for use by my wife and I.\r\n\r\nI'd be especially happy if the work I'm doing for a Google-hosted app could be self-hosted at home. Seeing as the development environment for App Engine runs on my laptop, I'm willing to bet I can hack the whole shebang into a simple, special-purpose app to download and double-click on a home desktop PC for use as your sync hub.\r\n\r\nAnyway, [check it out][impl] and let me know what you think.\r\n\r\n[dw]: http://www.scripting.com/davenet/2001/01/04/desktopWebsites.html#4\r\n[dave]: http://www.scripting.com/davenet/1997/09/14/FractionalHorsepowerHTTPSe.html\r\n[desktopserver]: http://www.decafbad.com/twiki/bin/view/Main/DesktopWebAppServer\r\n[sync-server]: http://hg.mozilla.org/services/sync-server/\r\n[july4]: http://en.wikipedia.org/wiki/Independence_Day_%28United_States%29\r\n[sync]: http://www.mozilla.com/en-US/firefox/sync/\r\n[servers]: https://services.mozilla.com/\r\n\r\n
\r\n

Archived Comments

\r\n \r\n \r\n \r\n
\r\n ", "parentPath": "./content/posts/archives/2010/2010-07-05-firefox-sync-server-on-google-app-engine", "path": "2010/07/05/firefox-sync-server-on-google-app-engine", "thumbnail": "http://mozcom-cdn.mozilla.net/img/firefox/sync/sync-background.png", "needsBuild": true, "prevPostPath": "2010/06/22/case-study-building-a-bookmark-management-ui-for-mozillas-byob", "prevPostTitle": "Case Study: Building a Bookmark Management UI for Mozilla's BYOB", "nextPostPath": "2010/09/27/so-simultaneously-extraordinary-and-mundane", "nextPostTitle": "so simultaneously extraordinary and mundane" }