Installation of Python

We’re using Python 3.x because Python 3 handles non English letters better due to native UTF-8 unicode support. Python 3 is the future of Python, and only old projects should maintain Python 2 compatability. We want to avoid installing or using Python 2 and modern versions of Ubuntu by default do not come with Python2. We only care about Python 3.x compatability for our crawlers.

sudo apt-get -y install build-essential python3-dev
wget -qO- https://bootstrap.pypa.io/get-pip.py | sudo -H python3