Add requirement-test.txt to use cpu pytorch and update github action

Finish comparison of common HF inference setups, bitsandbytes quantisation, sharded load/save

Cleanup unused

Update readme

Update README.md

Update python-app.yml

Add pytest.ini to simplify tests without overkill of making this a package

Create python-app.yml for tests

Update code agent functionaly to be configurable and stream

Add requirements.txt

Update readme

Run with flash-attention

Add docker compse for system without nvidia container runtime

Implement basic timing and use flash-attention

Give the container a name