Forums - Thread Details
  • State Suggested Answer
  • Replies 3 replies
  • Answers 1 answer
  • Subscribers 320 subscribers
  • Views 1141 views
  • Users 0 members are here
Forum Actions
Related

scheduler job execute more than one time

Manson ho

sugarcrm version: SugarCRM Version 11.0.3 (Build 292 P) (Q2 2021) (professional)

I have a monthly invoice renewal cron job. It run on every 1 day of each month and will create around 4000 invoices.
The problem is I found some invoice is created more than 1 or 2 randomly and usually no more than 10 duplicates each month.

I have checked the job_queue table, all job status is done and 0 requeue and none of it have retry_count.

I have no clue where to check and why these scheduler job run more than once.

Any suggestion would be appreciated.

Parents
  • 0

    This sounds like a custom scheduler job. It's not easy to find an exact cause without seeing your scheduler's code.

    Most custom schedulers should be in:

    custom/Extension/modules/Schedulers/Ext/ScheduledTasks

    the script name should be the same as the Job field you see in the Scheduler. So, for example if the Job field says function::generateInvoices

    then you should find the code at: custom/Extension/modules/Schedulers/Ext/ScheduledTasks/generateInvoices.php

    If your instance is old enough, the code may still be in the old entry point format and therefore in:

    custom/entry_points/

    My guess is that there is some flaw in the logic that is picking up some records more than once, perhaps a bad join in a query?

    I would check the corresponding script, see what the criteria is for processing the records and see if there are any flaws in that logic that may cause some records to be picked up twice. 

    Check to make sure that the appropriate records are flagged as processed once the invoice is generated so if the scheduler does run more than once it does not pick up duplicates.

    If all that is correct then it's possible that some records are not being flagged correctly, maybe there is an error that is particular to that record which causes it to not to be flagged?
    Adding some logging and monitoring the PHP and Sugar Log while the job is running may help you identify which records are being reprocessed and why.

    Hopefully something stands out to you once you find the right script.
    FrancescaS

Reply
  • 0

    This sounds like a custom scheduler job. It's not easy to find an exact cause without seeing your scheduler's code.

    Most custom schedulers should be in:

    custom/Extension/modules/Schedulers/Ext/ScheduledTasks

    the script name should be the same as the Job field you see in the Scheduler. So, for example if the Job field says function::generateInvoices

    then you should find the code at: custom/Extension/modules/Schedulers/Ext/ScheduledTasks/generateInvoices.php

    If your instance is old enough, the code may still be in the old entry point format and therefore in:

    custom/entry_points/

    My guess is that there is some flaw in the logic that is picking up some records more than once, perhaps a bad join in a query?

    I would check the corresponding script, see what the criteria is for processing the records and see if there are any flaws in that logic that may cause some records to be picked up twice. 

    Check to make sure that the appropriate records are flagged as processed once the invoice is generated so if the scheduler does run more than once it does not pick up duplicates.

    If all that is correct then it's possible that some records are not being flagged correctly, maybe there is an error that is particular to that record which causes it to not to be flagged?
    Adding some logging and monitoring the PHP and Sugar Log while the job is running may help you identify which records are being reprocessed and why.

    Hopefully something stands out to you once you find the right script.
    FrancescaS

Children
  • 0 in reply to Francesca Shiekh

    Thank you Francesca,

    yes, it's a custom scheduler job.

    The list that need to create invoice is match in the job_queue. For example, there are 4000 invoice should be create on the 2022-10, the number of row in job_queue is also 4000. However, there 4008 invoice was created at the end.

    We don't use flag but we did check if there are any invoice for this month before creating the invoice.

    The duplicate invoice is random generated every month and we found not clue for that.

    We found below article and there is parameter related to scheduler job, at the beginner we thought it's due to the scheduler job is running too long and trigger the job run again, and we try to adjust the parameter to make to longer but still have duplicate invoice and the job_queue table show that all job is success and not retry.

    jobs.min_retry_interval


    support.sugarcrm.com/.../

    Finally, thank you for the suggestion. We may use a flag to check if we still can't find out the reason.