The defeat at Williams' former club put a big dent in Colchester's promotion bid and they have slipped to sixth ahead of Saturday's trip to Walsall.
"It was a massive three points dropped for us," admitted Williams.
"The manager has got every right to drag us in to training from dawn 'til dusk until we get it right."
Source: Team Talk
Follow Footymad on Twitter for the latest, breaking football news and views.