Transferring single entry between gemfire WAN clusterAdd a new server to Gemfire cluster hosting a replicated regionHow to bootstrap spring application context from gemfire?Pivotal Gemfire NoAvailableLocatorsExceptionA connection to a distributed system already exist in this VMControlling Gemfire cache updates in the backgroundGemfire WAN Gateway-sender configurationGemfire WAN with Peer to Peer combinedGemfire/geode native client configuration for failoverInitialize a GemFire cache by loading a Map of data from Spring Boot applicationTransferring data through clusters using gemfire
How to bake one texture for one mesh with multiple textures blender 2.8
Open a doc from terminal, but not by its name
Has any country ever had 2 former presidents in jail simultaneously?
Store Credit Card Information in Password Manager?
What is this called? Old film camera viewer?
Why is it that I can sometimes guess the next note?
What should you do if you miss a job interview (deliberately)?
How do you respond to a colleague from another team when they're wrongly expecting that you'll help them?
Did arcade monitors have same pixel aspect ratio as TV sets?
Creepy dinosaur pc game identification
Closed-form expression for certain product
Is the U.S. Code copyrighted by the Government?
Are the IPv6 address space and IPv4 address space completely disjoint?
is this legal and f i dont come up with extra money is the deal off
What was the exact wording from Ivanhoe of this advice on how to free yourself from slavery?
copy and scale one figure (wheel)
Delivering sarcasm
What was this official D&D 3.5e Lovecraft-flavored rulebook?
How to indicate a cut out for a product window
What is Cash Advance APR?
Reverse int within the 32-bit signed integer range: [−2^31, 2^31 − 1]
The IT department bottlenecks progress. How should I handle this?
How to explain what's wrong with this application of the chain rule?
Does an advisor owe his/her student anything? Will an advisor keep a PhD student only out of pity?
Transferring single entry between gemfire WAN cluster
Add a new server to Gemfire cluster hosting a replicated regionHow to bootstrap spring application context from gemfire?Pivotal Gemfire NoAvailableLocatorsExceptionA connection to a distributed system already exist in this VMControlling Gemfire cache updates in the backgroundGemfire WAN Gateway-sender configurationGemfire WAN with Peer to Peer combinedGemfire/geode native client configuration for failoverInitialize a GemFire cache by loading a Map of data from Spring Boot applicationTransferring data through clusters using gemfire
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
add a comment |
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
add a comment |
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
I have two gemfire (version 8.2) clusters (sender and receiver) connected through WAN. Sender cluster gets data from DB and transmits entries to Receiver through WAN gateway until both clusters are online. Sometime few cache nodes from Receiver cluster goes down due to environment issue that causes data loss in Receiver cluster and impacts my clients connected to it. We are using gemfire-toolkit to transmit all data from sender to receiver in case almost all data is missing, but this solution doesn't fit right if there is few data missing in Receiver cluster.
I have a requirement that if my client connected to receiver cluster is looking for an entry and that not available in cache, I want to load that entry from Sender cluster on the fly. Also I can't rely on gateway-sender as it will transmit data asynchronously according to configured batch-time-interval.
I am thinking to expose RESTful end-point in sender cluster and configure a cache loader in receiver to call that end-point, get data and put into the it's cluster.
Is there anyway I can ask Sender cluster to transmit required entry to receiver synchronously or immediately without exposing any web-service. Or is there any other best solution someone can propose me explore?
gemfire spring-data-gemfire
gemfire spring-data-gemfire
asked Mar 8 at 4:32
sanitsanit
95111018
asked Mar 8 at 4:32
sanitsanit
95111018
edited Mar 9 at 14:00
sanit
asked Mar 8 at 4:32
sanitsanit
95111018
asked Mar 8 at 4:32
sanitsanit
95111018
asked Mar 8 at 4:32
sanitsanit
95111018
95111018
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55056765%2ftransferring-single-entry-between-gemfire-wan-cluster%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
From your description it looks like you can easily get to know exactly what entries are missing from the receiving cluster... if that's the case, then the easiest solution would be to simply "touch" (region.get() followed by a region.put() without modifying the value) those entries on the sending cluster.
This will basically generate a new event on the sending cluster, which will be automatically replicated to the receiving cluster without requiring anything extra on your end.
Hope this helps.
Cheers.
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
answered Mar 8 at 9:34
Juan RamosJuan Ramos
53128
53128
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that theCacheLoaderis synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.
– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Correct, I have key with me that is missing, but the problem is how should I invoke get() followed by put() on Sender cluster. As like gemtouch, I can register a function on Sender cluster which will perform "get();put()" but my Receiver cluster can't call that function as it must connect to Sender as client but Receiver itself is another independent server cluster and gemfire has restriction where a VM can't be both client and server at the same time.
– sanit
Mar 9 at 14:17
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that the
CacheLoader is synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.– Juan Ramos
Mar 11 at 11:00
Hello Sanit, I've missed that part of the requirement, sorry about that... I'm not aware of any way of doing this out of box. The REST approach sounds feasible, though, just keep in mind that the
CacheLoader is synchronously invoked by the member when there's a cache miss so you should take extra care regarding time outs when invoking the REST endpoint and cluster workload.– Juan Ramos
Mar 11 at 11:00
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
As a side note, GemFire comes with a REST API out of the box so you can use that instead of implementing your own one, you can have a look at Developing REST Applications for Pivotal GemFire.
– Juan Ramos
Mar 11 at 11:01
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55056765%2ftransferring-single-entry-between-gemfire-wan-cluster%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
