TURBOT
title Bot for liquor licenses in NYC (nys-liquor-licenses) in_development
description bot for opencorporates mission 615
current run state not running
last run
next run n/a
created by k-nut (Knut Hühne)
last reviewed by phil_smith
Automatic state update
inglesp commented about 9 years ago

Bot moved to 'in_development' from 'scheduled', and all earlier runs deleted.

Bot state update
commented about 9 years ago

A run succeeded; scheduling the next run

Bot state update
commented about 9 years ago

A run started

Bot state update
commented over 9 years ago

A run succeeded; scheduling the next run

Bot state update
commented over 9 years ago

A run started

Bot state update
commented over 9 years ago

An initial run was triggered manually by a moderator

Bot state update
commented over 9 years ago

Automatic bot state update. Was in state running, now in state to_be_scheduled

Bug in code
phil_smith commented over 9 years ago

Currently failing because it's trying to parse an empty field as a date. It should also be parsing in ISO format which it isn't.

(no subject)

Hi Knut
Super-quick turnaround, thanks!
A couple of other small changes we'd like you to make before we accept the bot:
1) Could you convert the start and end dates to the yyyy-mm-dd format?
2) Since all the licences are for liquor stores in NYC, the jurisdiction can actually be us_ny, rather than USA.

(no subject)

Hi Knut,
Thanks for this. Unfortunately the bot was not able to run to completion, because the identifying field for the transformed record is "License_Serial_Number", but this is not present in the transformed record. Instead, I think the identifying field should be "licence_number", since this is what the "License_Serial_Number" field in the primary record is transformed to.
If you manage to do this today, we'll make this fix -- we're keen to hit our target of 10 million records by the end of the week!
Thanks,
Peter

(no subject)

Didn't run to completion first time as docker process was killed because of memory error. Rerunning.

Run history

event metadata

Config

{
  "bot_id": "nys-liquor-licenses",
  "title": "Bot for liquor licenses in NYC",
  "description": "bot for opencorporates mission 615",
  "language": "python",
  "data_type": "primary data",
  "identifying_fields": [
    "License_Serial_Number"
  ],
  "transformers": [
    {
      "file": "licence_transformer.py",
      "data_type": "simple-licence",
      "identifying_fields": [
        "licence_number"
      ]
    }
  ],
  "files": [
    "scraper.py",
    "licence_transformer.py"
  ],
  "frequency": "monthly",
  "publisher": {
    "name": "OPEN-NY",
    "url": "https://data.ny.gov/",
    "terms": "Copyright 2014 OPEN-NY",
    "terms_url": "https://data.ny.gov/download/77gx-ii52/application/pdf"
  }
}