Know when web pages change! Stay on top of new information! Live your data-life pro-actively instead of re-actively, do not rely on manipulative social media for consuming important information.

Maybe you need to be notified the moment a government or company web page changes, or possibly you’re waiting for an item to go on sale.

This can be installed and run on a Raspberry Pi at home, or installed quickly as a Docker image.

See https://github.com/dgtlmoon/changedetection.io

#technology #opensource #selfhosted #changedetection #monitoring

  • Janis@feddit.de
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    1 year ago

    The developer of changedetection.io is deleting questions and discussion on github and bans like it is reddit.

    Especially when asked why changedetection.io only works with provider BrightData for proxies the dev is fast at deleting.

    I am getting the impression this is a sales tool for bright data and that the dev is NOT OK.

    Let me know if you know of ANYONE using proxies in changedetection that are NOT bright data.

    An example: https://github.com/dgtlmoon/changedetection.io/discussions/1539

    Original question in april and the rest of the discussion is gone and the thread is locked.

    • Yote.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      Thanks for pointing this out. I use changedetection.io and Huginn - I’m going to see if I can consolidate my scraping into just Huginn instead.

        • Yote.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I’m still finagling with it but I used the Website Agent and xpaths and it seems to work as intended. I followed a bit of this guide. The problem I’m currently trying to solve is that one of the websites I monitor lazy-loads content with JS, and huginn tries to instantly grab html data.

          • Janis@feddit.de
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            i have selenium standalone container and they dont support javascript and cookies out of the box. will check that linode guide. thanks.

            was fiddleling with n8n and portia aswell…but never to much success.

    • GadgeteerZA@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      That’s not good. I did not use it that long as I was having issues with how it was checking. Actually using Distell Web Monitor Chrome extension to watch for price changes (and shows a history) on many shopping sites I’m watching.