Spinn3r 2.2.2 Escapes From the Laboratory

Spinn3r 2.2.2 escaped from the hatch and is now free to wreak havoc upon the blogosphere.

This is mostly a point release. There has been a lot of backend work done including new hardware and database changes but most of these updates aren't visible to our user base.

New changes include:

• New force option when registering new weblogs. We had a number of our users attempt to register weblogs with peculiar URL structure. We now allow them to register the URLs anyway with this new force option.
• New Spinn3r reference client which implements changes necessary to force a source.register.
• Fixed a bug with Feedburner URL handling where content would be ignored for feeds that had too many URL redirections.
• We're now indexing content at 30 minute intervals. Spinn3r was previously indexing cyclical and non-pinged feeds once per hour but we've been able to tighten this up a bit with our new hardware.
• Reduced some of our content buffering variables to allow ping handling to be a bit more realtime. Pinged content is now indexed within 2 minutes from the time we've received a ping rather than the 5 minutes we were using before.
• We've pushed some new weblog discovery code which is humming along nicely. We've discovered approximately 1M new weblogs since last week and about 25k new mainstream media news sources. These were only made visible to our indexer after a number of ranking and content classification tweaks.

Comments

[aw]

Cool, that's LOST :)