Deployment

a Crawler is deployed by pushing changes to the master. The CI Feature of gitlab executes the crawler. All crawlwers are writung the structured data inti the local firectory /tmp/scrapy-json/