Is there any way to detect when a URL must be decode twice?2019 Community Moderator ElectionIs there any way to kill a Thread?ASP.NET MVC parse URL query partDetect encoding of URL in Javadecode URL only non-ascii characterUrl decode UTF-8 in PythonURL parameter Decoding not workingHow to know if a URL is decoded/encoded?URL UTF-8 Decoding Pythondecode URL in ANTHow to decode list of urls in file

School performs periodic password audits. Is my password compromised?

Python 3.6+ function to ask for a multiple-choice answer

Learning to quickly identify valid fingering for piano?

Has a sovereign Communist government ever run, and conceded loss, on a fair election?

What is "desert glass" and what does it do to the PCs?

Too soon for a plot twist?

Can inspiration allow the Rogue to make a Sneak Attack?

Why can't we use freedom of speech and expression to incite people to rebel against government in India?

What does it mean when I add a new variable to my linear model and the R^2 stays the same?

Can a Mimic (container form) actually hold loot?

A bug in Excel? Conditional formatting for marking duplicates also highlights unique value

Integrating function with /; in its definition

ESPP--any reason not to go all in?

Using the imperfect indicative vs. subjunctive with si

Why won't the strings command stop?

Called into a meeting and told we are being made redundant (laid off) and "not to share outside". Can I tell my partner?

Iron deposits mined from under the city

Convert an array of objects to array of the objects' values

Why do we call complex numbers “numbers” but we don’t consider 2 vectors numbers?

Is it a Cyclops number? "Nobody" knows!

Remove object from array based on array of some property of that object

When to use the term transposed instead of modulation?

Giving a talk in my old university, how prominently should I tell students my salary?

Was it really inappropriate to write a pull request for the company I interviewed with?



Is there any way to detect when a URL must be decode twice?



2019 Community Moderator ElectionIs there any way to kill a Thread?ASP.NET MVC parse URL query partDetect encoding of URL in Javadecode URL only non-ascii characterUrl decode UTF-8 in PythonURL parameter Decoding not workingHow to know if a URL is decoded/encoded?URL UTF-8 Decoding Pythondecode URL in ANTHow to decode list of urls in file










0















I have the following URL:



https://www.example.com/%2522%25D0%25B7%25D0%25B5%25D0%25BB%25D0%25B5%25D0%25BD-%25D1%2581%25D0%25B2%25D1%258F%25D1%2582%2522


If I unquote the URL, I get the following:



>>> urllib.parse.unquote(url)
'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


Which tells me that I need to unquote it yet again, like so:



>>> urllib.parse.unquote(url)
'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


I notice that with most of the URLs that have been encoded twice, they have the %25 (the quote character) in them. Is this efficient for detecting a URL that needs to be decoded twice, or are there more characters? If doing this for billions of URLs, most of which are fine with a single decoding, are there any disadvantages to decoding twice for every URL?










share|improve this question


























    0















    I have the following URL:



    https://www.example.com/%2522%25D0%25B7%25D0%25B5%25D0%25BB%25D0%25B5%25D0%25BD-%25D1%2581%25D0%25B2%25D1%258F%25D1%2582%2522


    If I unquote the URL, I get the following:



    >>> urllib.parse.unquote(url)
    'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


    Which tells me that I need to unquote it yet again, like so:



    >>> urllib.parse.unquote(url)
    'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


    I notice that with most of the URLs that have been encoded twice, they have the %25 (the quote character) in them. Is this efficient for detecting a URL that needs to be decoded twice, or are there more characters? If doing this for billions of URLs, most of which are fine with a single decoding, are there any disadvantages to decoding twice for every URL?










    share|improve this question
























      0












      0








      0








      I have the following URL:



      https://www.example.com/%2522%25D0%25B7%25D0%25B5%25D0%25BB%25D0%25B5%25D0%25BD-%25D1%2581%25D0%25B2%25D1%258F%25D1%2582%2522


      If I unquote the URL, I get the following:



      >>> urllib.parse.unquote(url)
      'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


      Which tells me that I need to unquote it yet again, like so:



      >>> urllib.parse.unquote(url)
      'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


      I notice that with most of the URLs that have been encoded twice, they have the %25 (the quote character) in them. Is this efficient for detecting a URL that needs to be decoded twice, or are there more characters? If doing this for billions of URLs, most of which are fine with a single decoding, are there any disadvantages to decoding twice for every URL?










      share|improve this question














      I have the following URL:



      https://www.example.com/%2522%25D0%25B7%25D0%25B5%25D0%25BB%25D0%25B5%25D0%25BD-%25D1%2581%25D0%25B2%25D1%258F%25D1%2582%2522


      If I unquote the URL, I get the following:



      >>> urllib.parse.unquote(url)
      'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


      Which tells me that I need to unquote it yet again, like so:



      >>> urllib.parse.unquote(url)
      'https://www.example.com/%22%D0%B7%D0%B5%D0%BB%D0%B5%D0%BD-%D1%81%D0%B2%D1%8F%D1%82%22'


      I notice that with most of the URLs that have been encoded twice, they have the %25 (the quote character) in them. Is this efficient for detecting a URL that needs to be decoded twice, or are there more characters? If doing this for billions of URLs, most of which are fine with a single decoding, are there any disadvantages to decoding twice for every URL?







      python urldecode






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked yesterday









      Franz KafkaFranz Kafka

      149120




      149120






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55023174%2fis-there-any-way-to-detect-when-a-url-must-be-decode-twice%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55023174%2fis-there-any-way-to-detect-when-a-url-must-be-decode-twice%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Thal And Out Agency railway station See also References External links Navigation menuOfficial Web Site of Pakistan RailwaysArchivedOfficial Web Site of Pakistan Railwayseeexpanding ite

          Understanding generators in Python2019 Community Moderator ElectionGenerator function not working pythonFor loop not executing two timesGenerators - Printing generated valuesWhy can a python generator only be used once?What exactly do generators do?What does the “yield” keyword do?What does “list comprehension” mean? How does it work and how can I use it?sklearn Kfold acces single fold instead of for loopIs a generator the callable? Which is the generator?Apply Border To Range Of Cells Using OpenpyxlCalling an external command in PythonWhat are metaclasses in Python?What is the difference between @staticmethod and @classmethod?Finding the index of an item given a list containing it in PythonDifference between append vs. extend list methods in PythonHow can I safely create a nested directory in Python?Does Python have a ternary conditional operator?Understanding slice notationUnderstanding Python super() with __init__() methodsDoes Python have a string 'contains' substring method?

          How can I change the color of pagination dots of UIPageControl?How to change UIPageControl dotsIs there a way to change page indicator dots colorCustomize dot with image of UIPageControl at index 0 of UIPageControlNo visible @interface for 'NSObject<PageControlDelegate>' declares the selector 'pageControlPageDidChange:'How to change the color of pagination dots in UIPageControl with a different color per pagepagecontrol indicator custom image instead of DefaultChanging the colour of UIPageControl dots in MonoTouchpagecontrol selectable page visibility color?Alternative way to load ViewControllers on a UIPageControlHow to set only layer.border-color for UIpage control dots in swiftHow can I develop for iPhone using a Windows development machine?How to change the name of an iOS app?UITableView - change section header coloruipagecontrol indicator(dot)issueCustom UIPageControl dots color not changingchange the interspace between UIPageControl dotsHow to change Status Bar text color in iOSHow can I change image tintColor in iOS and WatchKitUIPageControl dots with larger space in between each dotsHow to change the color of pagination dots in UIPageControl with a different color per page