Hi Chris
Have investigated this. There are one or two bugs in the bot, one which led to all the most recent runs being empty, and the other which meant we weren't processing historic archives.
1) See output at http://turbot.opencorporates.com/bots/uk_importers_data/runs/612/metadata. The problem is that we assume filenames definitely match this format, but there is a file at openc@morph1:~/sites/morph/releases/20140715085537/db/scrapers/data/uk_importers_data/data/hmrc_importers/SIAI11~1 which doesn't match this format. I can't fine a file matching that name in any of the downloaded archives so perhaps this isn't a bug and we should just blow away the archives and try again. Because we had cacluated we needed 89 runs, and because there was a bug (now fixed) in reliably getting the exit code from a run, it was assumed these were all successful (and therefore empty) runs. In short: probably no action required, though potentially we could consider logging failures to parse rather than erroring -- but I think we probably should actually leave this.
2) The historic archive files are unzipped correctly, but then the glob in files_for_processing assumes they start `SIAI11`. Actually the historic archive files appear to start `siai11`. Therefore we didn't process any of them.
If you ended up fixing this today, give us a shout before pushing as Peter is fixing up some morph stuff and it might be better to wait a bit first. Also we should manually clear the old run data and ES data.
Thanks