I love how search engines display inaccessible links.

  • @CrayonRosary@lemmy.world
    link
    fedilink
    English
    66 days ago

    When google started to index paywalled things…

    Google has (had?) a rule. If a site lets them index their paywalled content, then the site must deliver the full content if the referrer is google.com or else they will de-index the site. So when clicking a link on google, the full article should appear. It was an old trick to just google the article title to find a link and click through to read a paywalled article.

    Is that policy gone now?

    • @jet@hackertalks.com
      link
      fedilink
      English
      66 days ago

      as far as i can tell that policy never existed. The first instance of this was for academic articles being indexed behind a paywall, and they NEVER worked with the referrer being google.

      • @hayes_@sh.itjust.works
        link
        fedilink
        English
        76 days ago

        It kind of existed when Google included a link to every site’s cached content, but they removed that years ago.

          • @TangledHyphae@lemmy.world
            link
            fedilink
            English
            15 days ago

            I am surprised I didn’t even notice that, I used to use it for when sites changed or were down. I guess there’s always internet archive sites if I were so inclined, but still sad.