Code sharing on Kaggle¶
Kaggle is a cloud environment for sharing code in python and R. Kaggle is built on a Jupyter Notebook infrastructure, however, code can be shared as either notebooks or plain scripts. The code shared by CanWIN is typically useful for data manipulation in the cleaning stage.
Two kinds of notebooks are shared:
These are simply source scripts in python or R, which will require editing by the user (such as editing the value of specific variables) so that the script can be tailored to the user's data. They can simply be downloaded directly from Kaggle. They are suited to persons who are familiar with coding and running scripts on their own computer.
These notebooks are for users who wish to process their data in the cloud without having to download any scripts, packages, or software. These notebooks incorporate interactive widgets so that a user can easily make selections or enter information without having to edit the source script. Users can upload their data files directly to Kaggle, run the notebook, and downland their cleaned files. No muss, no fuss.
If you are interested in using or modifying a script, contact a data curator for the CanWIN Kaggle credentials: email@example.com.
Once you have received the credentials and logged in, click the button below to be taken to a list of shared notebooks. For a quick guide to finding and running these shared notebooks, go to the Using interactive notebooks page.
For data curators, our internal Kaggle scripts can be found here.
|Basic file cleaning||Reorder columns, rename columns, add columns, delete columns, and merge multiple files into one.|
|Decimal or Jullian day to date||Converts a column with decimal days fo the year (also called Jullian days in some cases) to UTC date.|
|Seconds since reference time or epoch||Converts a column with seconds since a reference time to UTC time. Some GPS sensors records time in this format, for example.|
|Thermosalinograph (TSG) CNV to CSV conversion||Converts TSG CNV files to CSV|
|Provincial Chemistry data processing||This editor merges one row of units and one row of VMV codes with column headers, producing a file with one cleaned header row without spaces/special characters.|
|Date-Time conversion||Converting date-time column values into a different date format.|
|Date-Time merge||Merging separate columns of dates and times into one date-time column.|
|ERDDAP Metadata profile generation||This script generates a partial ERDDAP metadata profile to be added to the Datasetes.XML file. It grabs applicable metadata from the dataset’s CKAN page.|
|Castaway CTD processing||This script was created to process Castaway CTD files to be ingested into the ODV software.|