5 1 45 DEV 1-ddda9c7e 31-35 Create test script for the whole package. We should create a script that would run all tests we have. Let's try to copy the model from cam shell tests: https://github.com/yegor256/cam/tree/master/tests. Don't forget to remove this puzzle. Makefile @h1alexbel aliaksei.bialiauski@hey.com 9 7 30 DEV 7-347d3609 26-29 Compute CPD and RC metrics too. We need to compute CPD and RC metrics too, however for now we don't have the proper dataset after ghminer execution. Need to collect required data first, and then compute CPDs and RCs. Don't forget to remove this puzzle. steps/metrics.py @h1alexbel aliaksei.bialiauski@hey.com 43 37 30 DEV 37-c1c0b2c2 43-45 Look for CLUSTER=true option in order to run clustering. We should run cluster.sh and zip.sh only if -e "CLUSTER=true" was passed inside the docker container. Don't forget to remove this puzzle. Makefile @h1alexbel aliaksei.bialiauski@hey.com 48 29 45 DEV 29-4533b240 31-35 Generate embeddings for all the text in texts.csv. Some of the texts generated after textualize_repos.py cannot be processed on the embeddings endpoint that lead to raising decoding exception: 'json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)'. We should fix that and remove `head(500)` frame limitation. steps/embed.py @h1alexbel aliaksei.bialiauski@hey.com 49 29 30 DEV 29-bbd95ea7 55-57 Language detection produces inaccurate results for mixed language text. We should fix that in order to filter out more repositories with non-english texts. Don't forget to remove this puzzle. tests/test_english.py @h1alexbel aliaksei.bialiauski@hey.com