3 Big Query table reference
This page contains the list and location of the most current BigQuery datasets and tables for the various GFW data products. The BQ tables in the below table are the default tables to be used when starting a new analysis.
Last update: * Date: 2022-08-19
* By: Tyler Clavelle
Subject | Description | BQ Dataset | BQ Table | Pipeline version | Owner |
---|---|---|---|---|---|
AIS | AIS pipeline dataset to use | pipe_production_v20201001 |
2.5 | Andres | |
AIS | AIS position table (all messages) | pipe_production_v20201001 |
messages_scored_ |
2.5 | Andres |
AIS | AIS position table (thinned) | pipe_production_v20201001 |
research_messages |
2.5 | Tyler |
Vessel identity | Vessel registry database | vessel_database |
all_vessels_vYYYYMMDD |
2.5 | Jaeyoon |
Vessel identity | Vessel info tables | gfw_research |
vi_ssvid_[byyear]_vYYYYMMDD |
2.5 | Tyler |
Vessel identity | Annual fishing vessel list | gfw_research |
fishing_vessels_ssvid_vYYYYMMDD |
2.5 | Tyler |
Vessel identity | Annual carrier vessel list | vessel_database |
carrier_vessels_byyear_v20220101 |
2.5 | Jaeyoon |
Encounters | Encounter events no speed restrictions | pipe_production_v20201001 |
encounters |
2.5 | Nate |
Encounters | Encounter events in Published format for Products | pipe_production_v20201001 |
published_events_encounters |
2.5 | Nate |
Loitering | Loitering events | pipe_production_v20201001 |
loitering published_events_loitering |
2.5 | Pete |
Loitering | Loitering events in Published format for Products | pipe_production_v20201001 |
published_events_loitering |
2.5 | Hannah |
Ports | Anchorage locations | anchorages |
named_anchorages_v20211026 |
2.5 | Nate |
Ports | Individual port events (entry, start, gap, stop, exit) | pipe_production_v20201001 |
proto_raw_port_events_* |
2.5 | Tim H |
Ports | Archived original individual port events (entry, start, gap, stop, exit) | pipe_production_v20201001 |
archive_20201001_port_events_* |
2.5 | Tim H |
Ports | Port visits (grouped port events) | pipe_production_v20201001 |
proto_port_visits |
2.5 | Tim H |
Ports | Port visits (grouped port events) in Published format for Products | pipe_production_v20201001 |
published_events_port_visits |
2.5 | Hannah |
Ports | Previous version of Port visits version (grouped port events) | pipe_production_v20201001 |
port_visits_ |
2.5 | Tim H |
Ports | Vessel voyages between anchorages | pipe_production_v20201001 |
proto_voyages_c2 proto_voyages_c3 proto_voyages_c4 |
2.5 | Tim H |
Ports | Previous version of Vessel voyages between anchorages | pipe_production_v20201001 |
voyages |
2.5 | Tim H |
VIIRS | VIIRS vessel detections | pipe_viirs_production_v20220112 |
raw_vbd_global raw_vbd_global_without_noise |
Masaki | |
VIIRS | VIIRS vessel detections that matched/unmatched with AIS/VMS | pipe_production_v20201001 |
proto_matches_raw_vbd_global_3top_v20210514 |
2.5 | Masaki |
AIS gaps | AIS gaps and suspected disabling events | pipe_production_v20201001 |
proto_ais_gap_events |
2.5 | Tyler |
AIS offsetting | AIS offsetting by seg_id |
gfw_research_precursors |
offsetting_year_seg_v20220609 |
2.5 | Pete |
VMS | Peru VMS | pipe_peru_production_v20211126 |
2.5 | Andres | |
VMS | Panama VMS | pipe_panama_production_v20211126 |
2.5 | Andres | |
VMS | Chile VMS | pipe_chile_production_v20211126 |
2.5 | Andres | |
VMS | Indonesia VMS | pipe_indonesia_production_v20200320 |
2.5 | Andres | |
VMS | Brazil VMS | pipe_brazil_production_v20211126 |
2.5 | Claudino | |
VMS | Mexico VMS | pipe_mexico_oceana_production_v20210811 |
2.5 | Andres | |
VMS | Costa Rica VMS | pipe_costarica_production_v20211126 |
2.5 | Andres | |
VMS | Ecuador VMS | pipe_ecuador_production_v20211126 |
2.5 | Andres | |
VMS | Belize VMS | pipe_belize_production_v20220304 |
2.5 | Matias |