title Grenadan Non-Bank Financial Licences (gd-garfin) storing_data view rate in graphite
description This bot extracts information on credit unions, insurance companies and money services in Grenada.
current run state storing may have failed
last run single run snapshot 12 scrape succeeded on April 11, 2016 13:02
next run enqueued for a run, docker status
created by dinotash (Tom Curtis)
last reviewed by peter.evans
Bot state update
commented about 8 years ago

A run finished; its output is now being processed

Bot state update
commented about 8 years ago

A run started

Bot state update
commented about 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Saved vars cleared
dinotash commented about 8 years ago

Bot state update
commented about 8 years ago

A run started

Bot state update
commented about 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Saved vars cleared
dinotash commented about 8 years ago

Bot state update
commented about 8 years ago

A run started

Bot state update
commented over 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Saved vars cleared
dinotash commented over 8 years ago

Bot state update
commented over 8 years ago

A run started

Bot state update
commented over 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Saved vars cleared
dinotash commented over 8 years ago

Bot state update
commented over 8 years ago

A run started

Bot state update
commented over 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Saved vars cleared
dinotash commented over 8 years ago

Bot state update
commented over 8 years ago

A run started

Bot state update
commented over 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Saved vars cleared
dinotash commented over 8 years ago

Bot state update
commented over 8 years ago

A run started

Bot state update
commented over 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Bot state update
peter.evans commented over 8 years ago

A failed run was resumed by the moderator

Bot state update
commented over 8 years ago

A run failed

Bot state update
commented over 8 years ago

A run started

Bot state update
commented over 8 years ago

A snapshot completed; scheduling the first run of the next snapshot

Bot state update
commented over 8 years ago

A run started

Bot state update
commented almost 9 years ago

A run succeeded; scheduling the next run

Bot state update
commented almost 9 years ago

A run started

Bot state update
commented almost 9 years ago

A run succeeded; scheduling the next run

Bot state update
commented almost 9 years ago

A run started

(no subject)
peter.evans commented almost 9 years ago

GARFIN website finally alive again, so this one is importing into opencorporates now.
Thanks,
Peter

Bot state update
commented almost 9 years ago

A run succeeded; scheduling the next run

Bot state update
peter.evans commented almost 9 years ago

The bot was accepted; starting run to ingest reviewed data

Bot state update
commented almost 9 years ago

A draft run succeeded; sending for final review

Bot state update
peter.evans commented almost 9 years ago

A moderator has approved the draft bot; running a full draft for final review

Bot state update
peter.evans commented almost 9 years ago

A moderator has started reviewing the draft bot

(no subject)
peter.evans commented almost 9 years ago

Site currently down, waiting for it to be back up before accepting scraper.

Re: (turbot bot [gd-garfin])
dinotash commented almost 9 years ago

Hi Peter
Updated bot submitted.
The jurisdiction classification comes from the “category” field in the primary data. This is based on the fact each page on the website shows a different sort of activity.
See you on Tuesday hopefully
Tom

Bot state update
commented almost 9 years ago

Run succeeded; sending for draft review

Bot state update
dinotash commented almost 9 years ago

The bot was pushed; scheduling a draft run

(no subject)
peter.evans commented about 9 years ago

Hi Tom
Yes that's right - adding jurisdiction_classification to the identifying_fields would remove the dupes & allow the bot to run, we need to do the same for the primary data as well but I think I couldn't see a field equivalent to jurisdiction_classification being output, so suggest that one might need to be. Let me know if anything is still unclear there or if I need to have another look at the bot.
Thanks!
Peter

Re: (turbot bot [gd-garfin])
dinotash commented about 9 years ago

Hi Peter
Just want to check what amendments are needed for this bot.
Are you saying to make jurisdiction_classification/equivalent an identifying field for the primary data or licence or both?
Thanks
Tom

(no subject)
peter.evans commented about 9 years ago

Hi Tom,
This scraper is looking good. I think it may have some issues with identifying_fields at the moment, I think if we add jurisdiction_classification to the identifying fields and output a corresponding field in the primary data and include that in the identifying_fields it should import into opencorporates just fine.
Thanks as always
Peter

Bot state update
commented about 9 years ago

A draft run succeeded; sending for review

Bot state update
commented about 9 years ago

A draft run started

Bot state update
dinotash commented about 9 years ago

The bot was pushed; scheduling a draft run

Run history

event metadata
single run snapshot draft scrape succeeded on March 12, 2015 09:08 83 rows in less than a minute
single run snapshot draft scrape succeeded on April 26, 2015 09:19 83 rows in less than a minute
single run snapshot final draft scrape succeeded on May 05, 2015 07:48 83 rows in less than a minute
single run snapshot 1 prescrape scrape succeeded on May 05, 2015 07:59 83 rows in less than a minute
single run snapshot 2 scrape succeeded on June 05, 2015 08:00 83 rows in 1 minute
single run snapshot 3 scrape succeeded on July 05, 2015 08:00 83 rows in 1 minute
single run snapshot 4 scrape succeeded on August 05, 2015 08:00 83 rows in 1 minute
single run snapshot 5 scrape failed on September 05, 2015 08:00 0 rows in 1 minute
single run snapshot 5 scrape succeeded on September 07, 2015 09:46 83 rows in less than a minute
single run snapshot 6 scrape succeeded on October 07, 2015 09:47 83 rows in 1 minute
single run snapshot 7 scrape succeeded on November 07, 2015 09:47 83 rows in 1 minute
single run snapshot 8 scrape succeeded on December 07, 2015 09:47 83 rows in less than a minute
single run snapshot 9 scrape succeeded on January 07, 2016 09:47 83 rows in 1 minute
single run snapshot 10 scrape succeeded on February 07, 2016 09:47 83 rows in 1 minute
single run snapshot 11 scrape succeeded on March 07, 2016 09:47 83 rows in less than a minute
single run snapshot 12 scrape succeeded on April 11, 2016 13:02 83 rows in 3 minutes

Config

{
  "bot_id": "gd-garfin",
  "title": "Grenadan Non-Bank Financial Licences",
  "description": "This bot extracts information on credit unions, insurance companies and money services in Grenada.",
  "language": "python",
  "data_type": "primary data",
  "identifying_fields": [
    "name",
    "category"
  ],
  "company_fields": {
    "name": "name"
  },
  "files": [
    "scraper.py",
    "licence.py"
  ],
  "frequency": "monthly",
  "publisher": {
    "name": "Grenada Authority for the Regulation of Financial Institutions (GARFIN)",
    "url": "http://www.garfin.org/",
    "terms": "Copyright, all rights reserved",
    "terms_url": "http://www.garfin.org/"
  },
  "transformers": [
    {
      "file": "licence.py",
      "data_type": "simple-licence",
      "identifying_fields": [
        "company_name",
        "jurisdiction_classification"
      ]
    }
  ]
}