Sounds like populations in the 100s to 1,000s are intended for mid-late game, and certainly enough for crime and factionalism. Trade and exchange of ideas can spur social upheaval. Old gods vs new gods. Eras of progressivism followed by revival of traditions. Civilization has never been a steady march forward, advancement is not inevitable, and many cultures languish and collapse or are absorbed. Even in modern times we still see the specter of regressvism and the false promises of nationalism in many western countries.