Bulk update and insert using Meteor method call in loop making high cpu usageMeteor's subscription and sync are slowHow efficient can Meteor be while sharing a huge collection among many clients?how best to 'tail -f' a large collection in mongo through meteor?Meteor collection Method calls waiting, or how to implement batch DB operation efficientlyMeteor collection insert not updating on clientCrud operations on client only collection in meteorMeteor Method Insert into collection when collection.find().count() === 0insert new doc via autoform hooks call meteor methodWhy is Meteor using so much bandwidth? Is it Houston Admin Subscriptions?Meteor call/methods only triggers once?Meteor long computation time on MongoDB insert/update

Why did Neo believe he could trust the machine when he asked for peace?

Do VLANs within a subnet need to have their own subnet for router on a stick?

Is it legal for company to use my work email to pretend I still work there?

Languages that we cannot (dis)prove to be Context-Free

What do you call a Matrix-like slowdown and camera movement effect?

What do the dots in this tr command do: tr .............A-Z A-ZA-Z <<< "JVPQBOV" (with 13 dots)

Is a tag line useful on a cover?

What would happen to a modern skyscraper if it rains micro blackholes?

How did the USSR manage to innovate in an environment characterized by government censorship and high bureaucracy?

Is it important to consider tone, melody, and musical form while writing a song?

Are the number of citations and number of published articles the most important criteria for a tenure promotion?

What are these boxed doors outside store fronts in New York?

Fencing style for blades that can attack from a distance

What are the differences between the usage of 'it' and 'they'?

Why doesn't H₄O²⁺ exist?

How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?

Why not use SQL instead of GraphQL?

"You are your self first supporter", a more proper way to say it

Is it unprofessional to ask if a job posting on GlassDoor is real?

Smoothness of finite-dimensional functional calculus

In Japanese, what’s the difference between “Tonari ni” (となりに) and “Tsugi” (つぎ)? When would you use one over the other?

Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?

What's the output of a record cartridge playing an out-of-speed record

What typically incentivizes a professor to change jobs to a lower ranking university?



Bulk update and insert using Meteor method call in loop making high cpu usage


Meteor's subscription and sync are slowHow efficient can Meteor be while sharing a huge collection among many clients?how best to 'tail -f' a large collection in mongo through meteor?Meteor collection Method calls waiting, or how to implement batch DB operation efficientlyMeteor collection insert not updating on clientCrud operations on client only collection in meteorMeteor Method Insert into collection when collection.find().count() === 0insert new doc via autoform hooks call meteor methodWhy is Meteor using so much bandwidth? Is it Houston Admin Subscriptions?Meteor call/methods only triggers once?Meteor long computation time on MongoDB insert/update






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















My application is on METEOR@1.6.0.1 and I am using  reywood:publish-composite ,  matb33:collection-hooks  for db relations.



I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.



Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.



How i can do above task in correct and efficient way. Please help.



Thanks.










share|improve this question






















  • Can you please show the code that relates to your description?

    – Jankapunkt
    Mar 2 at 20:22











  • Possible duplicate of Meteor's subscription and sync are slow

    – Christian Fritz
    Mar 3 at 0:36











  • See stackoverflow.com/a/19599027/1087119.

    – Christian Fritz
    Mar 3 at 0:36

















0















My application is on METEOR@1.6.0.1 and I am using  reywood:publish-composite ,  matb33:collection-hooks  for db relations.



I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.



Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.



How i can do above task in correct and efficient way. Please help.



Thanks.










share|improve this question






















  • Can you please show the code that relates to your description?

    – Jankapunkt
    Mar 2 at 20:22











  • Possible duplicate of Meteor's subscription and sync are slow

    – Christian Fritz
    Mar 3 at 0:36











  • See stackoverflow.com/a/19599027/1087119.

    – Christian Fritz
    Mar 3 at 0:36













0












0








0








My application is on METEOR@1.6.0.1 and I am using  reywood:publish-composite ,  matb33:collection-hooks  for db relations.



I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.



Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.



How i can do above task in correct and efficient way. Please help.



Thanks.










share|improve this question














My application is on METEOR@1.6.0.1 and I am using  reywood:publish-composite ,  matb33:collection-hooks  for db relations.



I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.



Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.



How i can do above task in correct and efficient way. Please help.



Thanks.







mongodb meteor meteor-blaze meteor-publications meteor-galaxy






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 2 at 12:37









AmitAmit

246




246












  • Can you please show the code that relates to your description?

    – Jankapunkt
    Mar 2 at 20:22











  • Possible duplicate of Meteor's subscription and sync are slow

    – Christian Fritz
    Mar 3 at 0:36











  • See stackoverflow.com/a/19599027/1087119.

    – Christian Fritz
    Mar 3 at 0:36

















  • Can you please show the code that relates to your description?

    – Jankapunkt
    Mar 2 at 20:22











  • Possible duplicate of Meteor's subscription and sync are slow

    – Christian Fritz
    Mar 3 at 0:36











  • See stackoverflow.com/a/19599027/1087119.

    – Christian Fritz
    Mar 3 at 0:36
















Can you please show the code that relates to your description?

– Jankapunkt
Mar 2 at 20:22





Can you please show the code that relates to your description?

– Jankapunkt
Mar 2 at 20:22













Possible duplicate of Meteor's subscription and sync are slow

– Christian Fritz
Mar 3 at 0:36





Possible duplicate of Meteor's subscription and sync are slow

– Christian Fritz
Mar 3 at 0:36













See stackoverflow.com/a/19599027/1087119.

– Christian Fritz
Mar 3 at 0:36





See stackoverflow.com/a/19599027/1087119.

– Christian Fritz
Mar 3 at 0:36












1 Answer
1






active

oldest

votes


















0














I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.



You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.



Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.



If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction






share|improve this answer























    Your Answer






    StackExchange.ifUsing("editor", function ()
    StackExchange.using("externalEditor", function ()
    StackExchange.using("snippets", function ()
    StackExchange.snippets.init();
    );
    );
    , "code-snippets");

    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "1"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54958601%2fbulk-update-and-insert-using-meteor-method-call-in-loop-making-high-cpu-usage%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0














    I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.



    You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.



    Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.



    If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction






    share|improve this answer



























      0














      I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.



      You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.



      Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.



      If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction






      share|improve this answer

























        0












        0








        0







        I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.



        You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.



        Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.



        If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction






        share|improve this answer













        I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.



        You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.



        Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.



        If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Mar 9 at 2:13









        Paul CochranePaul Cochrane

        32114




        32114





























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Stack Overflow!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54958601%2fbulk-update-and-insert-using-meteor-method-call-in-loop-making-high-cpu-usage%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Thal And Out Agency railway station See also References External links Navigation menuOfficial Web Site of Pakistan RailwaysArchivedOfficial Web Site of Pakistan Railwayseeexpanding ite

            Posting a File and Associated Data to a RESTful WebService preferably as JSON2019 Community Moderator ElectionREST URI convention - Singular or plural name of resource while creating itUploading both data and files in one form using Ajax?How do I upload a file with metadata using a REST web service?REST API - file (ie images) processing - best practicesSpring: JSON data and file in the same requestREST API Put large dataPosting a file and JSON data to Spring rest serviceRESTful Web Service Upload/Download Large Data With JSONREST API Design sending JSON data and a file to the api in same requestPost JSONArray to REST servicePUT vs. POST in RESTParsing values from a JSON file?JavaScript/jQuery to download file via POST with JSON dataHow do I upload a file with metadata using a REST web service?How to POST JSON data with Curl from Terminal/Commandline to Test Spring REST?Separate REST JSON API server and client?what's the correct way to send a file from REST web service to client?How do I write JSON data to a file?What is “406-Not Acceptable Response” in HTTP?REST API - file (ie images) processing - best practices

            How can I change the color of pagination dots of UIPageControl?How to change UIPageControl dotsIs there a way to change page indicator dots colorCustomize dot with image of UIPageControl at index 0 of UIPageControlNo visible @interface for 'NSObject<PageControlDelegate>' declares the selector 'pageControlPageDidChange:'How to change the color of pagination dots in UIPageControl with a different color per pagepagecontrol indicator custom image instead of DefaultChanging the colour of UIPageControl dots in MonoTouchpagecontrol selectable page visibility color?Alternative way to load ViewControllers on a UIPageControlHow to set only layer.border-color for UIpage control dots in swiftHow can I develop for iPhone using a Windows development machine?How to change the name of an iOS app?UITableView - change section header coloruipagecontrol indicator(dot)issueCustom UIPageControl dots color not changingchange the interspace between UIPageControl dotsHow to change Status Bar text color in iOSHow can I change image tintColor in iOS and WatchKitUIPageControl dots with larger space in between each dotsHow to change the color of pagination dots in UIPageControl with a different color per page