HOW TO USE agreement.py (Thomas M. Lippincott) The script can calculate alpha, kappa, pi and S using either simple binary equality or MASI as the distance metric between labelings. The file example.txt contains an example data file with the "integrated coding example" from Artstein and Poesio's paper. It creates a DataSet class that resembles the "common notation" from Artstein & Poesio, so any metric definable with the i/k/c/etc notation is easy to add. Running "python agreement.py -h" will print usage info. e.g. "python agreement.py -f example.txt -a alpha -d binary" prints the alpha value from the paper. Right now the script only imports data in the format of the example file, but this process is separate from the class itself so if there is a particular data source/file format you can send me an example or description and I'll add it to the import methods.