An overview of practical lessons learned transitioning from LLM proof-of-concept stages to delivering a production-grade, responsibly managed multi-stage financial crime entity extraction pipeline processing over a million news articles a day.