lead import, slow then partially fails

Question

I am trying to import about 400 leads from a spreadsheet using the the Lead import process.

We have done things many times over the years but suddenly it is very slow, processes 200 leads in three hours then reports the import failed.

Oddly the leads it does import all have identical timestamps in the date_entered field.

I don't have any major changes recorded in my logs that would justify a change in behavior like this. Though there has been an uptick in people mass-updating leads at the same time.

I added logging to the logic hooks we have.

For the first minute or so things progress quickly, then I start seeing an interval of approx 1minute between the before save and the after save logic hooks.

There are no indications of slow queries or locks on the DB side.

The Elasticsearch server has some spikes in disk usage, but I don't think that's unusual.

I realize this is all very vague information, but any thoughts on what else could be happening to cause these issues?

What else should I be looking at?

thank you,
FrancescaS

Francesca Shiekh · Accepted Answer

Whenever an event happens SugarCRM tries to invoke any related logic hooks, if such they don't exist so nothing is execute. I agree that looking at sugarcrm.log under debug log.level is a kind of scary. As the timestamp are the same one in those records then I may say it is not the real issue. A better approach would be reviewing eventual sugarLogic formulas on Leads or related to Leads. Additionally Let us know the elapsed time between consecutives save event on Leads (log on initiating and finishing a specific logic_hook) on Leads.