Bulk update and insert using Meteor method call in loop making high cpu usageMeteor's subscription and sync are slowHow efficient can Meteor be while sharing a huge collection among many clients?how best to 'tail -f' a large collection in mongo through meteor?Meteor collection Method calls waiting, or how to implement batch DB operation efficientlyMeteor collection insert not updating on clientCrud operations on client only collection in meteorMeteor Method Insert into collection when collection.find().count() === 0insert new doc via autoform hooks call meteor methodWhy is Meteor using so much bandwidth? Is it Houston Admin Subscriptions?Meteor call/methods only triggers once?Meteor long computation time on MongoDB insert/update
Why did Neo believe he could trust the machine when he asked for peace?
Do VLANs within a subnet need to have their own subnet for router on a stick?
Is it legal for company to use my work email to pretend I still work there?
Languages that we cannot (dis)prove to be Context-Free
What do you call a Matrix-like slowdown and camera movement effect?
What do the dots in this tr command do: tr .............A-Z A-ZA-Z <<< "JVPQBOV" (with 13 dots)
Is a tag line useful on a cover?
What would happen to a modern skyscraper if it rains micro blackholes?
How did the USSR manage to innovate in an environment characterized by government censorship and high bureaucracy?
Is it important to consider tone, melody, and musical form while writing a song?
Are the number of citations and number of published articles the most important criteria for a tenure promotion?
What are these boxed doors outside store fronts in New York?
Fencing style for blades that can attack from a distance
What are the differences between the usage of 'it' and 'they'?
Why doesn't H₄O²⁺ exist?
How is the claim "I am in New York only if I am in America" the same as "If I am in New York, then I am in America?
Why not use SQL instead of GraphQL?
"You are your self first supporter", a more proper way to say it
Is it unprofessional to ask if a job posting on GlassDoor is real?
Smoothness of finite-dimensional functional calculus
In Japanese, what’s the difference between “Tonari ni” (となりに) and “Tsugi” (つぎ)? When would you use one over the other?
Why doesn't Newton's third law mean a person bounces back to where they started when they hit the ground?
What's the output of a record cartridge playing an out-of-speed record
What typically incentivizes a professor to change jobs to a lower ranking university?
Bulk update and insert using Meteor method call in loop making high cpu usage
Meteor's subscription and sync are slowHow efficient can Meteor be while sharing a huge collection among many clients?how best to 'tail -f' a large collection in mongo through meteor?Meteor collection Method calls waiting, or how to implement batch DB operation efficientlyMeteor collection insert not updating on clientCrud operations on client only collection in meteorMeteor Method Insert into collection when collection.find().count() === 0insert new doc via autoform hooks call meteor methodWhy is Meteor using so much bandwidth? Is it Houston Admin Subscriptions?Meteor call/methods only triggers once?Meteor long computation time on MongoDB insert/update
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
My application is on METEOR@1.6.0.1 and I am using reywood:publish-composite , matb33:collection-hooks for db relations.
I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.
Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.
How i can do above task in correct and efficient way. Please help.
Thanks.
mongodb meteor meteor-blaze meteor-publications meteor-galaxy
asked Mar 2 at 12:37
AmitAmit
246
add a comment |
My application is on METEOR@1.6.0.1 and I am using reywood:publish-composite , matb33:collection-hooks for db relations.
I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.
Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.
How i can do above task in correct and efficient way. Please help.
Thanks.
mongodb meteor meteor-blaze meteor-publications meteor-galaxy
asked Mar 2 at 12:37
AmitAmit
246
Can you please show the code that relates to your description?
– Jankapunkt
Mar 2 at 20:22
Possible duplicate of Meteor's subscription and sync are slow
– Christian Fritz
Mar 3 at 0:36
See stackoverflow.com/a/19599027/1087119.
– Christian Fritz
Mar 3 at 0:36
add a comment |
My application is on METEOR@1.6.0.1 and I am using reywood:publish-composite , matb33:collection-hooks for db relations.
I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.
Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.
How i can do above task in correct and efficient way. Please help.
Thanks.
mongodb meteor meteor-blaze meteor-publications meteor-galaxy
asked Mar 2 at 12:37
AmitAmit
246
My application is on METEOR@1.6.0.1 and I am using reywood:publish-composite , matb33:collection-hooks for db relations.
I need to insert a list of 400 people into collection from excel file, for it currently i am inserting from client using Meteor method inside loop but when i see on galaxy during this CPU usage is very high 70-80% or some time 100%.
Once all data inserted, i need to send a mail and update the record so i am sending mail and update using Meteor method call one by one that again making CPU 70-80%.
How i can do above task in correct and efficient way. Please help.
Thanks.
mongodb meteor meteor-blaze meteor-publications meteor-galaxy
mongodb meteor meteor-blaze meteor-publications meteor-galaxy
asked Mar 2 at 12:37
AmitAmit
246
asked Mar 2 at 12:37
AmitAmit
246
asked Mar 2 at 12:37
AmitAmit
246
asked Mar 2 at 12:37
AmitAmit
246
asked Mar 2 at 12:37
AmitAmit
246
246
Can you please show the code that relates to your description?
– Jankapunkt
Mar 2 at 20:22
Possible duplicate of Meteor's subscription and sync are slow
– Christian Fritz
Mar 3 at 0:36
See stackoverflow.com/a/19599027/1087119.
– Christian Fritz
Mar 3 at 0:36
add a comment |
Can you please show the code that relates to your description?
– Jankapunkt
Mar 2 at 20:22
Possible duplicate of Meteor's subscription and sync are slow
– Christian Fritz
Mar 3 at 0:36
See stackoverflow.com/a/19599027/1087119.
– Christian Fritz
Mar 3 at 0:36
Can you please show the code that relates to your description?
– Jankapunkt
Mar 2 at 20:22
Can you please show the code that relates to your description?
– Jankapunkt
Mar 2 at 20:22
Possible duplicate of Meteor's subscription and sync are slow
– Christian Fritz
Mar 3 at 0:36
Possible duplicate of Meteor's subscription and sync are slow
– Christian Fritz
Mar 3 at 0:36
See stackoverflow.com/a/19599027/1087119.
– Christian Fritz
Mar 3 at 0:36
See stackoverflow.com/a/19599027/1087119.
– Christian Fritz
Mar 3 at 0:36
add a comment |
1 Answer
1
active
oldest
votes
I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.
You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.
Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.
If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54958601%2fbulk-update-and-insert-using-meteor-method-call-in-loop-making-high-cpu-usage%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.
You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.
Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.
If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
add a comment |
I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.
You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.
Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.
If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
add a comment |
I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.
You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.
Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.
If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
I suspect that you are not using oplog tailing and you are trying to insert when some other part of your app has subscriptions to publications open. Without this meteor polls the collections and generates lots of slow queries at each document insert.
You can enable it by passing an url to meteor at startup. See https://docs.meteor.com/environment-variables.html#MONGO-OPLOG-URL for more info.
Having oplog tailing eases the strain on the server and should reduce the high cpu usage to a manageable level.
If you are still having issues then you may have to set up some tracing e.g. monti-apm https://docs.montiapm.com/introduction
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
answered Mar 9 at 2:13
Paul CochranePaul Cochrane
32114
32114
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54958601%2fbulk-update-and-insert-using-meteor-method-call-in-loop-making-high-cpu-usage%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Can you please show the code that relates to your description?
– Jankapunkt
Mar 2 at 20:22
Possible duplicate of Meteor's subscription and sync are slow
– Christian Fritz
Mar 3 at 0:36
See stackoverflow.com/a/19599027/1087119.
– Christian Fritz
Mar 3 at 0:36