How to write sub-query using WITH in PostgreSQL2019 Community Moderator ElectionKeeping it simple and how to do multiple CTE in a querySQL Server CTE referred in self joins slowCTE with Group By returning the same results as basic queryRecursive References are not allowed in Sub_queries T-SQLPostgreSQL CTE/Sub-Query with generate_series performance issuesMaximum of COUNT by group and joining on EQUALS and NOT EQUALS conditionHow to join CTE query with another table in SQL Server 2008CTE Execution OrderImprove performance on CTE with sub-queriesRecursive CTEs to pull BOM (Bill of Material)

Do I really need to have a scientific explanation for my premise?

Possible to detect presence of nuclear bomb?

Trig Subsitution When There's No Square Root

MySQL importing CSV files really slow

Why restrict private health insurance?

Can't make sense of a paragraph from Lovecraft

Does an unused member variable take up memory?

When a wind turbine does not produce enough electricity how does the power company compensate for the loss?

Why does cron require MTA for logging?

Is it safe to abruptly remove Arduino power?

What is Tony Stark injecting into himself in Iron Man 3?

The meaning of ‘otherwise’

Doubts in understanding some concepts of potential energy

Why do phishing e-mails use faked e-mail addresses instead of the real one?

Was it really inappropriate to write a pull request for the company I interviewed with?

What will happen if my luggage gets delayed?

Plausibility of Mushroom Buildings

PTIJ: Why does only a Shor Tam ask at the Seder, and not a Shor Mu'ad?

I can't die. Who am I?

How do spaceships determine each other's mass in space?

Does Christianity allow for believing on someone else's behalf?

Is it possible to avoid unpacking when merging Association?

Confusion about Complex Continued Fraction

Gaining more land



How to write sub-query using WITH in PostgreSQL



2019 Community Moderator ElectionKeeping it simple and how to do multiple CTE in a querySQL Server CTE referred in self joins slowCTE with Group By returning the same results as basic queryRecursive References are not allowed in Sub_queries T-SQLPostgreSQL CTE/Sub-Query with generate_series performance issuesMaximum of COUNT by group and joining on EQUALS and NOT EQUALS conditionHow to join CTE query with another table in SQL Server 2008CTE Execution OrderImprove performance on CTE with sub-queriesRecursive CTEs to pull BOM (Bill of Material)










0















I am trying to get twitter data of narendramodi using below command.



SELECT b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count,b.favorite_count as like_count,count(reply_to_status_id) as reply_count,f.tweet_impression_count,f.tweet_engagement_count,f.tweet_engagement_rate 
FROM twitter_users a LEFT JOIN twitter_tweets b on a.user_id=b.user_id
LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
LEFT JOIN twitter_tweet_metric_aggregates f on f.metric_timestamp=
(select max(metric_timestamp) FROM twitter_tweet_metric_aggregates g
WHERE g.t_id=f.t_id and g.t_id=b.t_id)
WHERE a.twitter_screen_name= 'narendramodi'
GROUP BY b.t_id,a.profile_image
,b.tweet_text,b.retweet_count,b.favorite_count,
e.media_media_url,f.imp_count,f.eng_count,f.eng_rate);


Query was working correctly But, in the above query I have used sub-select to get recent data of imp_counts based on timestamp. Because of that Query_cost was huge and so it was taking more than 15min for query execution. I want to reduce that and should able to execute within 10seconds. For that reason I was trying to use WITH (CTE) expression.



Here it is



WITH metric_counts AS (
SELECT max(metric_timestamp),f.t_id
FROM twitter_tweet_metric_aggregates f LEFT JOIN twitter_tweets b on
f.t_id=b.t_id
)
SELECT
b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count
,b.favorite_count as like_count, count(reply_to_status_id) as
reply_count,metric_counts.imp_count
,metric_counts.eng_count,metric_counts.eng_rate

FROM twitter_users as a
LEFT JOIN twitter_tweets as b on a.twitter_user_id=b.twitter_user_id
LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
LEFT JOIN metric_counts on metric_counts.t_id = b.t_id WHERE
lower(a.twitter_screen_name)=lower('narendramodi')
GROUP BY b.t_id,a.profile_image,b.tweet_text,e.media_media_url,
b.retweet_count,b.favorite_count,
metric_counts.imp_count,metric_counts.eng_count,
metric_counts.eng_rate;


The query was executing but it is not giving imp_count,eng_count,eng_rate values from that particular table.



NOTE : If I remove that sub-select query was executing within 10sec.But I want that also to be included. For that I have used WITH but failing. So can anyone help me out on how to write first query using WITH expression.










share|improve this question




























    0















    I am trying to get twitter data of narendramodi using below command.



    SELECT b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count,b.favorite_count as like_count,count(reply_to_status_id) as reply_count,f.tweet_impression_count,f.tweet_engagement_count,f.tweet_engagement_rate 
    FROM twitter_users a LEFT JOIN twitter_tweets b on a.user_id=b.user_id
    LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
    LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
    LEFT JOIN twitter_tweet_metric_aggregates f on f.metric_timestamp=
    (select max(metric_timestamp) FROM twitter_tweet_metric_aggregates g
    WHERE g.t_id=f.t_id and g.t_id=b.t_id)
    WHERE a.twitter_screen_name= 'narendramodi'
    GROUP BY b.t_id,a.profile_image
    ,b.tweet_text,b.retweet_count,b.favorite_count,
    e.media_media_url,f.imp_count,f.eng_count,f.eng_rate);


    Query was working correctly But, in the above query I have used sub-select to get recent data of imp_counts based on timestamp. Because of that Query_cost was huge and so it was taking more than 15min for query execution. I want to reduce that and should able to execute within 10seconds. For that reason I was trying to use WITH (CTE) expression.



    Here it is



    WITH metric_counts AS (
    SELECT max(metric_timestamp),f.t_id
    FROM twitter_tweet_metric_aggregates f LEFT JOIN twitter_tweets b on
    f.t_id=b.t_id
    )
    SELECT
    b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count
    ,b.favorite_count as like_count, count(reply_to_status_id) as
    reply_count,metric_counts.imp_count
    ,metric_counts.eng_count,metric_counts.eng_rate

    FROM twitter_users as a
    LEFT JOIN twitter_tweets as b on a.twitter_user_id=b.twitter_user_id
    LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
    LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
    LEFT JOIN metric_counts on metric_counts.t_id = b.t_id WHERE
    lower(a.twitter_screen_name)=lower('narendramodi')
    GROUP BY b.t_id,a.profile_image,b.tweet_text,e.media_media_url,
    b.retweet_count,b.favorite_count,
    metric_counts.imp_count,metric_counts.eng_count,
    metric_counts.eng_rate;


    The query was executing but it is not giving imp_count,eng_count,eng_rate values from that particular table.



    NOTE : If I remove that sub-select query was executing within 10sec.But I want that also to be included. For that I have used WITH but failing. So can anyone help me out on how to write first query using WITH expression.










    share|improve this question


























      0












      0








      0








      I am trying to get twitter data of narendramodi using below command.



      SELECT b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count,b.favorite_count as like_count,count(reply_to_status_id) as reply_count,f.tweet_impression_count,f.tweet_engagement_count,f.tweet_engagement_rate 
      FROM twitter_users a LEFT JOIN twitter_tweets b on a.user_id=b.user_id
      LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
      LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
      LEFT JOIN twitter_tweet_metric_aggregates f on f.metric_timestamp=
      (select max(metric_timestamp) FROM twitter_tweet_metric_aggregates g
      WHERE g.t_id=f.t_id and g.t_id=b.t_id)
      WHERE a.twitter_screen_name= 'narendramodi'
      GROUP BY b.t_id,a.profile_image
      ,b.tweet_text,b.retweet_count,b.favorite_count,
      e.media_media_url,f.imp_count,f.eng_count,f.eng_rate);


      Query was working correctly But, in the above query I have used sub-select to get recent data of imp_counts based on timestamp. Because of that Query_cost was huge and so it was taking more than 15min for query execution. I want to reduce that and should able to execute within 10seconds. For that reason I was trying to use WITH (CTE) expression.



      Here it is



      WITH metric_counts AS (
      SELECT max(metric_timestamp),f.t_id
      FROM twitter_tweet_metric_aggregates f LEFT JOIN twitter_tweets b on
      f.t_id=b.t_id
      )
      SELECT
      b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count
      ,b.favorite_count as like_count, count(reply_to_status_id) as
      reply_count,metric_counts.imp_count
      ,metric_counts.eng_count,metric_counts.eng_rate

      FROM twitter_users as a
      LEFT JOIN twitter_tweets as b on a.twitter_user_id=b.twitter_user_id
      LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
      LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
      LEFT JOIN metric_counts on metric_counts.t_id = b.t_id WHERE
      lower(a.twitter_screen_name)=lower('narendramodi')
      GROUP BY b.t_id,a.profile_image,b.tweet_text,e.media_media_url,
      b.retweet_count,b.favorite_count,
      metric_counts.imp_count,metric_counts.eng_count,
      metric_counts.eng_rate;


      The query was executing but it is not giving imp_count,eng_count,eng_rate values from that particular table.



      NOTE : If I remove that sub-select query was executing within 10sec.But I want that also to be included. For that I have used WITH but failing. So can anyone help me out on how to write first query using WITH expression.










      share|improve this question
















      I am trying to get twitter data of narendramodi using below command.



      SELECT b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count,b.favorite_count as like_count,count(reply_to_status_id) as reply_count,f.tweet_impression_count,f.tweet_engagement_count,f.tweet_engagement_rate 
      FROM twitter_users a LEFT JOIN twitter_tweets b on a.user_id=b.user_id
      LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
      LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
      LEFT JOIN twitter_tweet_metric_aggregates f on f.metric_timestamp=
      (select max(metric_timestamp) FROM twitter_tweet_metric_aggregates g
      WHERE g.t_id=f.t_id and g.t_id=b.t_id)
      WHERE a.twitter_screen_name= 'narendramodi'
      GROUP BY b.t_id,a.profile_image
      ,b.tweet_text,b.retweet_count,b.favorite_count,
      e.media_media_url,f.imp_count,f.eng_count,f.eng_rate);


      Query was working correctly But, in the above query I have used sub-select to get recent data of imp_counts based on timestamp. Because of that Query_cost was huge and so it was taking more than 15min for query execution. I want to reduce that and should able to execute within 10seconds. For that reason I was trying to use WITH (CTE) expression.



      Here it is



      WITH metric_counts AS (
      SELECT max(metric_timestamp),f.t_id
      FROM twitter_tweet_metric_aggregates f LEFT JOIN twitter_tweets b on
      f.t_id=b.t_id
      )
      SELECT
      b.t_id,a.profile_image,b.tweet_text,e.media_media_url,b.retweet_count
      ,b.favorite_count as like_count, count(reply_to_status_id) as
      reply_count,metric_counts.imp_count
      ,metric_counts.eng_count,metric_counts.eng_rate

      FROM twitter_users as a
      LEFT JOIN twitter_tweets as b on a.twitter_user_id=b.twitter_user_id
      LEFT JOIN twitter_tweet_replies c on b.t_id = c.t_id
      LEFT JOIN twitter_tweet_media e on b.t_id = e.t_id
      LEFT JOIN metric_counts on metric_counts.t_id = b.t_id WHERE
      lower(a.twitter_screen_name)=lower('narendramodi')
      GROUP BY b.t_id,a.profile_image,b.tweet_text,e.media_media_url,
      b.retweet_count,b.favorite_count,
      metric_counts.imp_count,metric_counts.eng_count,
      metric_counts.eng_rate;


      The query was executing but it is not giving imp_count,eng_count,eng_rate values from that particular table.



      NOTE : If I remove that sub-select query was executing within 10sec.But I want that also to be included. For that I have used WITH but failing. So can anyone help me out on how to write first query using WITH expression.







      common-table-expression postgresql-9.4






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Mar 7 at 4:53







      bunny sunny

















      asked Mar 6 at 4:11









      bunny sunnybunny sunny

      74111




      74111






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55015445%2fhow-to-write-sub-query-using-with-in-postgresql%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55015445%2fhow-to-write-sub-query-using-with-in-postgresql%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Identity Server 4 is not redirecting to Angular app after login2019 Community Moderator ElectionIdentity Server 4 and dockerIdentityserver implicit flow unauthorized_clientIdentityServer Hybrid Flow - Access Token is null after user successful loginIdentity Server to MVC client : Page Redirect After loginLogin with Steam OpenId(oidc-client-js)Identity Server 4+.NET Core 2.0 + IdentityIdentityServer4 post-login redirect not working in Edge browserCall to IdentityServer4 generates System.NullReferenceException: Object reference not set to an instance of an objectIdentityServer4 without HTTPS not workingHow to get Authorization code from identity server without login form

          2005 Ahvaz unrest Contents Background Causes Casualties Aftermath See also References Navigation menue"At Least 10 Are Killed by Bombs in Iran""Iran"Archived"Arab-Iranians in Iran to make April 15 'Day of Fury'"State of Mind, State of Order: Reactions to Ethnic Unrest in the Islamic Republic of Iran.10.1111/j.1754-9469.2008.00028.x"Iran hangs Arab separatists"Iran Overview from ArchivedConstitution of the Islamic Republic of Iran"Tehran puzzled by forged 'riots' letter""Iran and its minorities: Down in the second class""Iran: Handling Of Ahvaz Unrest Could End With Televised Confessions""Bombings Rock Iran Ahead of Election""Five die in Iran ethnic clashes""Iran: Need for restraint as anniversary of unrest in Khuzestan approaches"Archived"Iranian Sunni protesters killed in clashes with security forces"Archived

          Can't initialize raids on a new ASUS Prime B360M-A motherboard2019 Community Moderator ElectionSimilar to RAID config yet more like mirroring solution?Can't get motherboard serial numberWhy does the BIOS entry point start with a WBINVD instruction?UEFI performance Asus Maximus V Extreme