Gradient calculation within custom loss functions in Tensorflow/KerasMake a custom loss function in kerasKeras/Tensorflow custom loss functionImplementing a custom loss function in KerasMake a custom loss function in kerasKeras custom loss function: Accessing current input patternWhy doesn't Keras need the gradient of a custom loss function?TensorFlow session inside Keras custom loss functionKeras: averaging different loss functionsKeras custom loss, having error in batch size in y_true and y_predUnderstanding Keras Loss Function Inputs in Reinforcement LearningKeras Custom Loss function to detect if an image is in a quadrant

How is it possible to have an ability score that is less than 3?

How much RAM could one put in a typical 80386 setup?

How long does it take to type this?

Why are only specific transaction types accepted into the mempool?

Copenhagen passport control - US citizen

Work Breakdown with Tikz

When blogging recipes, how can I support both readers who want the narrative/journey and ones who want the printer-friendly recipe?

Why is "Reports" in sentence down without "The"

How old can references or sources in a thesis be?

What is the offset in a seaplane's hull?

What do you call a Matrix-like slowdown and camera movement effect?

How do we improve the relationship with a client software team that performs poorly and is becoming less collaborative?

Shell script can be run only with sh command

I probably found a bug with the sudo apt install function

Are there any consumables that function as addictive (psychedelic) drugs?

How to report a triplet of septets in NMR tabulation?

Prevent a directory in /tmp from being deleted

What do you call something that goes against the spirit of the law, but is legal when interpreting the law to the letter?

Why are 150k or 200k jobs considered good when there are 300k+ births a month?

What makes Graph invariants so useful/important?

How do you conduct xenoanthropology after first contact?

What is the command to reset a PC without deleting any files

Is Social Media Science Fiction?

Circuitry of TV splitters



Gradient calculation within custom loss functions in Tensorflow/Keras


Make a custom loss function in kerasKeras/Tensorflow custom loss functionImplementing a custom loss function in KerasMake a custom loss function in kerasKeras custom loss function: Accessing current input patternWhy doesn't Keras need the gradient of a custom loss function?TensorFlow session inside Keras custom loss functionKeras: averaging different loss functionsKeras custom loss, having error in batch size in y_true and y_predUnderstanding Keras Loss Function Inputs in Reinforcement LearningKeras Custom Loss function to detect if an image is in a quadrant






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I'm trying to build a custom loss function which utilizes the gradient of the outputs predicted by the model (i.e. gradient of y_pred). For example, the loss function may try to minimize the mean squared error between the gradient of the model output (grad(y_pred)) and y_true.



Although many operations like taking the square of y_pred inside the custom loss function is okay, using its gradient within the custom loss function is lnot possible. I understand that this might be because y_pred is simply a reference to a computational graph, and doesn't have any values initially. Can someone please suggest a workaround for this?










share|improve this question






















  • Possible duplicate of Make a custom loss function in keras

    – alift
    Mar 9 at 6:40











  • It's not a duplicate of the question your link refers to. This is not about how to create a custom loss function, this is about doing a specific operation within it.

    – Tarak Nath Nandi
    Mar 9 at 15:37

















0















I'm trying to build a custom loss function which utilizes the gradient of the outputs predicted by the model (i.e. gradient of y_pred). For example, the loss function may try to minimize the mean squared error between the gradient of the model output (grad(y_pred)) and y_true.



Although many operations like taking the square of y_pred inside the custom loss function is okay, using its gradient within the custom loss function is lnot possible. I understand that this might be because y_pred is simply a reference to a computational graph, and doesn't have any values initially. Can someone please suggest a workaround for this?










share|improve this question






















  • Possible duplicate of Make a custom loss function in keras

    – alift
    Mar 9 at 6:40











  • It's not a duplicate of the question your link refers to. This is not about how to create a custom loss function, this is about doing a specific operation within it.

    – Tarak Nath Nandi
    Mar 9 at 15:37













0












0








0








I'm trying to build a custom loss function which utilizes the gradient of the outputs predicted by the model (i.e. gradient of y_pred). For example, the loss function may try to minimize the mean squared error between the gradient of the model output (grad(y_pred)) and y_true.



Although many operations like taking the square of y_pred inside the custom loss function is okay, using its gradient within the custom loss function is lnot possible. I understand that this might be because y_pred is simply a reference to a computational graph, and doesn't have any values initially. Can someone please suggest a workaround for this?










share|improve this question














I'm trying to build a custom loss function which utilizes the gradient of the outputs predicted by the model (i.e. gradient of y_pred). For example, the loss function may try to minimize the mean squared error between the gradient of the model output (grad(y_pred)) and y_true.



Although many operations like taking the square of y_pred inside the custom loss function is okay, using its gradient within the custom loss function is lnot possible. I understand that this might be because y_pred is simply a reference to a computational graph, and doesn't have any values initially. Can someone please suggest a workaround for this?







tensorflow keras loss-function






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 9 at 3:44









Tarak Nath NandiTarak Nath Nandi

1




1












  • Possible duplicate of Make a custom loss function in keras

    – alift
    Mar 9 at 6:40











  • It's not a duplicate of the question your link refers to. This is not about how to create a custom loss function, this is about doing a specific operation within it.

    – Tarak Nath Nandi
    Mar 9 at 15:37

















  • Possible duplicate of Make a custom loss function in keras

    – alift
    Mar 9 at 6:40











  • It's not a duplicate of the question your link refers to. This is not about how to create a custom loss function, this is about doing a specific operation within it.

    – Tarak Nath Nandi
    Mar 9 at 15:37
















Possible duplicate of Make a custom loss function in keras

– alift
Mar 9 at 6:40





Possible duplicate of Make a custom loss function in keras

– alift
Mar 9 at 6:40













It's not a duplicate of the question your link refers to. This is not about how to create a custom loss function, this is about doing a specific operation within it.

– Tarak Nath Nandi
Mar 9 at 15:37





It's not a duplicate of the question your link refers to. This is not about how to create a custom loss function, this is about doing a specific operation within it.

– Tarak Nath Nandi
Mar 9 at 15:37












0






active

oldest

votes












Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55073780%2fgradient-calculation-within-custom-loss-functions-in-tensorflow-keras%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55073780%2fgradient-calculation-within-custom-loss-functions-in-tensorflow-keras%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Thal And Out Agency railway station See also References External links Navigation menuOfficial Web Site of Pakistan RailwaysArchivedOfficial Web Site of Pakistan Railwayseeexpanding ite

Understanding generators in Python2019 Community Moderator ElectionGenerator function not working pythonFor loop not executing two timesGenerators - Printing generated valuesWhy can a python generator only be used once?What exactly do generators do?What does the “yield” keyword do?What does “list comprehension” mean? How does it work and how can I use it?sklearn Kfold acces single fold instead of for loopIs a generator the callable? Which is the generator?Apply Border To Range Of Cells Using OpenpyxlCalling an external command in PythonWhat are metaclasses in Python?What is the difference between @staticmethod and @classmethod?Finding the index of an item given a list containing it in PythonDifference between append vs. extend list methods in PythonHow can I safely create a nested directory in Python?Does Python have a ternary conditional operator?Understanding slice notationUnderstanding Python super() with __init__() methodsDoes Python have a string 'contains' substring method?

How can I change the color of pagination dots of UIPageControl?How to change UIPageControl dotsIs there a way to change page indicator dots colorCustomize dot with image of UIPageControl at index 0 of UIPageControlNo visible @interface for 'NSObject<PageControlDelegate>' declares the selector 'pageControlPageDidChange:'How to change the color of pagination dots in UIPageControl with a different color per pagepagecontrol indicator custom image instead of DefaultChanging the colour of UIPageControl dots in MonoTouchpagecontrol selectable page visibility color?Alternative way to load ViewControllers on a UIPageControlHow to set only layer.border-color for UIpage control dots in swiftHow can I develop for iPhone using a Windows development machine?How to change the name of an iOS app?UITableView - change section header coloruipagecontrol indicator(dot)issueCustom UIPageControl dots color not changingchange the interspace between UIPageControl dotsHow to change Status Bar text color in iOSHow can I change image tintColor in iOS and WatchKitUIPageControl dots with larger space in between each dotsHow to change the color of pagination dots in UIPageControl with a different color per page