Generates unique directory names

Configurable sleep times

Extra logging and controls added

Added more logging

Removed restriction on file processing

Update README.md

Fixed conf + Updated README

More logs + better install

Used config to setup file directories

Fixed remaining bugs in logger for master

Added connection to redis for log writer

Fixed bug in string

Cleaned code and various fixes

Removed unused tasks + Used log dir from conf

Removed last notion of env.yaml