Save predictions from tf.data and tf.keras.model.predict to HDFS2019 Community Moderator ElectionWhat is the quickest way to HTTP GET in Python?Python progression path - From apprentice to guruPeak detection in a 2D array“Large data” work flows using pandasKeras, how do I predict after I trained a model?Load saved checkpoint and predict not producing same results as in trainingReplacing tf.placeholder and feed_dict with tf.data APITensorflow: Low GPU Load when using tf.DataSave the prediction output of Tensorflow model into hdfs fileWhy should I use tf.data?

Does a difference of tense count as a difference of meaning in a minimal pair?

Are small insurances worth it?

Specifying a starting column with colortbl package and xcolor

Giving a career talk in my old university, how prominently should I tell students my salary?

Called into a meeting and told we are being made redundant (laid off) and "not to share outside". Can I tell my partner?

School performs periodic password audits. Is my password compromised?

Why do we say ‘pairwise disjoint’, rather than ‘disjoint’?

Proving a statement about real numbers

Signed and unsigned numbers

How do spaceships determine each other's mass in space?

How do we create new idioms and use them in a novel?

Help find my computational error for logarithms

Can I use a violin G string for D?

Are all players supposed to be able to see each others' character sheets?

Is it safe to abruptly remove Arduino power?

Is a piano played in the same way as a harmonium?

Does an unused member variable take up memory?

Professor forcing me to attend a conference, I can't afford even with 50% funding

When Schnorr signatures are part of Bitcoin will it be possible validate each block with only one signature validation?

Can one live in the U.S. and not use a credit card?

Can I negotiate a patent idea for a raise, under French law?

When a wind turbine does not produce enough electricity how does the power company compensate for the loss?

Has a sovereign Communist government ever run, and conceded loss, on a fair election?

In the late 1940’s to early 1950’s what technology was available that could melt a LOT of ice?



Save predictions from tf.data and tf.keras.model.predict to HDFS



2019 Community Moderator ElectionWhat is the quickest way to HTTP GET in Python?Python progression path - From apprentice to guruPeak detection in a 2D array“Large data” work flows using pandasKeras, how do I predict after I trained a model?Load saved checkpoint and predict not producing same results as in trainingReplacing tf.placeholder and feed_dict with tf.data APITensorflow: Low GPU Load when using tf.DataSave the prediction output of Tensorflow model into hdfs fileWhy should I use tf.data?










-1















I have a tf.data and have a trained tf.keras.model. I would like to save the results of tf.keras.model.predict( tf.data ) back to HDFS. I'm trying to find a way to do this for a large dataset to be run in a cluster. Hence I'm not preferring storing the predictions as an in-memory array.










share|improve this question


























    -1















    I have a tf.data and have a trained tf.keras.model. I would like to save the results of tf.keras.model.predict( tf.data ) back to HDFS. I'm trying to find a way to do this for a large dataset to be run in a cluster. Hence I'm not preferring storing the predictions as an in-memory array.










    share|improve this question
























      -1












      -1








      -1








      I have a tf.data and have a trained tf.keras.model. I would like to save the results of tf.keras.model.predict( tf.data ) back to HDFS. I'm trying to find a way to do this for a large dataset to be run in a cluster. Hence I'm not preferring storing the predictions as an in-memory array.










      share|improve this question














      I have a tf.data and have a trained tf.keras.model. I would like to save the results of tf.keras.model.predict( tf.data ) back to HDFS. I'm trying to find a way to do this for a large dataset to be run in a cluster. Hence I'm not preferring storing the predictions as an in-memory array.







      python tensorflow keras tensorflow-datasets






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Mar 7 at 5:24









      NitinNitin

      2,81211620




      2,81211620






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55036612%2fsave-predictions-from-tf-data-and-tf-keras-model-predict-to-hdfs%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55036612%2fsave-predictions-from-tf-data-and-tf-keras-model-predict-to-hdfs%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Identity Server 4 is not redirecting to Angular app after login2019 Community Moderator ElectionIdentity Server 4 and dockerIdentityserver implicit flow unauthorized_clientIdentityServer Hybrid Flow - Access Token is null after user successful loginIdentity Server to MVC client : Page Redirect After loginLogin with Steam OpenId(oidc-client-js)Identity Server 4+.NET Core 2.0 + IdentityIdentityServer4 post-login redirect not working in Edge browserCall to IdentityServer4 generates System.NullReferenceException: Object reference not set to an instance of an objectIdentityServer4 without HTTPS not workingHow to get Authorization code from identity server without login form

          2005 Ahvaz unrest Contents Background Causes Casualties Aftermath See also References Navigation menue"At Least 10 Are Killed by Bombs in Iran""Iran"Archived"Arab-Iranians in Iran to make April 15 'Day of Fury'"State of Mind, State of Order: Reactions to Ethnic Unrest in the Islamic Republic of Iran.10.1111/j.1754-9469.2008.00028.x"Iran hangs Arab separatists"Iran Overview from ArchivedConstitution of the Islamic Republic of Iran"Tehran puzzled by forged 'riots' letter""Iran and its minorities: Down in the second class""Iran: Handling Of Ahvaz Unrest Could End With Televised Confessions""Bombings Rock Iran Ahead of Election""Five die in Iran ethnic clashes""Iran: Need for restraint as anniversary of unrest in Khuzestan approaches"Archived"Iranian Sunni protesters killed in clashes with security forces"Archived

          Can't initialize raids on a new ASUS Prime B360M-A motherboard2019 Community Moderator ElectionSimilar to RAID config yet more like mirroring solution?Can't get motherboard serial numberWhy does the BIOS entry point start with a WBINVD instruction?UEFI performance Asus Maximus V Extreme