After messing around with YQL and the JobsGoLocal API over the weekend @AnthonySterling helped me unearth a problem with some job vacancy records where spaces and tabs were being entered, so I am stripping them all out now as the original zois file is fetched.

After getting initially very excited about YQL and streams from the weekend (each < 50k), it turns out that midweek streams at 3-4meg are too big for YQL and I get exceed-limit warnings.

I still have some ideas of for things you could go on and use YQL for though.

Reminder : if you are planning on fetching your local vacancies daily, you might be best not to do it on Sunday or Monday mornings as there are very few jobs in there.