[FEAT] Library-only mode and optional authentication

[abelanger5]

Is your feature request related to a problem? Please describe.

We'd like to improve support for lightweight environments by offering a library-only mode version of Hatchet which spawns a sidecar process which runs the Hatchet engine. Most of this initiative is reducing the footprint of the Hatchet engine to make it lightweight from a memory, CPU, and database utilization perspective.

Some other dependent work is:

• Removing the requirement for authentication for local setup
• Removing the polling intervals for UpdateDAGStatuses and UpdateTaskStatuses as they are the largest contributors to connection utilization and database CPU. This is being worked on in Feat: Direct task + dag status updates #3554

[gregfurman]

• Removing the requirement for authentication for local setup

Seems relevant to #2821