Skip to content

Automatically browses the "MediaMarkt Fundgrube" in your town and sends new products via Telegram.

Notifications You must be signed in to change notification settings

simonneutert/fundgrube

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FUNDGRUBE

not a script i would show my mother-in-law and brag about it... but, ..., well, it does the job 😅

Why?

At the time of writing this piece of bits, the "Fundgrube" did not offer sorting, filtering or anything you would call useful for a user.

But its a proper online shop with all the bells and whistles since then 🎉

What and how?

this tool curls through MediaMarkts public Fundgrube API.

IMPORTANT You may want an active telegram bot to use this script!

AND just the 5 newest pages are being tracked, if you don't set scope on certain outlet ids export FUNDGRUBE_OUTLET_IDS="418,576,798" !
NOT setting this env will track all outlets.

Results are written to the filesystem utilizing Clojure's edn data notation. The file with the last results is being copied and renamed, to serve as the source to identify changes (new postings/products in the Fundgrube 🤫).

You need JSON not EDN? Use jet!

Identified changes (products / postings) are then being sent to the telegram bot 🤖

Here's an example of how a post to telegram could look like:

Markt: Wiesbaden-Hasengarten
Produkt: PHILIPS 58PUS8546/12 LED TV (Flat, 58 Zoll / 146 cm, UHD 4K, SMART TV, Ambilight, Android TV™ 10 (Q))

Preis: 700.00 €

Artikel 2734789
-
LED TV / 146cm/58Zoll / UHD 4K,
Ultra Resolution, Dolby Vision, HDR10+, Micro Dimming Pro, ISF-Farbmanagement,
2 x 10 W Full-Range-Lautsprecher,
Ausschalt-Timer, Lichtsensor, Bildabschaltung (bei Radiobetrieb), Eco-Modus
https://assets.mmsrg.com/is/166325/12975367df8e182e57044734f5165e190/c3/-/29336490249241a3925bcb97e235b830

Run

After cloning this project, setup your environment variables. Please, check the outlet ids of your interest given below!

  1. install babashka
  2. setup your environment
    export FUNDGRUBE_TGRAM_API_KEY="1234567:ABCDEFGH-XYZ123"
    # you can find your channel/group/chat id by logging into web.telegram.org
    # selecting your channel/group/chat
    # BONUS: don't forget to prepend 100 🤷‍♂️ if your bot should post to a channel
    export FUNDGRUBE_TGRAM_CHANNEL="-100mychannelid"
    
    # !!! THIS IS OPTIONAL !!!
    export FUNDGRUBE_OUTLET_IDS="418,576,798"
  3. $ bb fundgrube.clj
  4. profit
  5. bro down

Setup Cronjobs

clone the product to your server, install babashka with the Quickstart script or pick another method, but for Debian based, the script is the way to go. As it will put bb in your path and set everything up correctly. Borkdude is trustworthy, the day he goes BlackHat will be a day we all will remember.

# have your environment variables stored/set in `.profile` 🤗
0,15,30,45 9-15 * * 1-6 cd /home/superman/fundgrube; source /home/superman/.profile; bb /home/superman/fundgrube/fundgrube.clj

Credits / Inspiration

inspired by: RomanNess/fundgrube-crawler

Outlet lists

One way to update the Outlets, outlets.json contains the copied object from fundgrube website:

cat outlets.json | \
   jq '.outlets | sort_by(.id) | .[] | select(.isActive == true) | "\(.id), \(.nameFull)"' | \
   jq -s '{outlets: .}' > outlets_jq.json
### Outlets (isActive == true) @2022-11-01
{
  "outlets": [
    "32, MediaMarkt Fellbach (Alte B14)",
    "99, MediaMarkt Neunkirchen",
    "114, MediaMarkt Itzehoe",
    "135, MediaMarkt Emden",
    "182, MediaMarkt Siegen – Weidenau",
    "189, MediaMarkt Stade",
    "190, MediaMarkt Berlin-Mitte im Alexa",
    "234, MediaMarkt Henstedt-Ulzburg",
    "246, MediaMarkt Baden-Baden",
    "250, MediaMarkt Düsseldorf-Metrostraße",
    "251, MediaMarkt Castrop-Rauxel (im Castrop-Park)",
    "252, MediaMarkt Alzey (im Rheinhessen-Center)",
    "253, MediaMarkt Saarlouis (im Globus-Center)",
    "254, MediaMarkt Heidenheim (Schloss Arkaden)",
    "256, MediaMarkt Wetzlar",
    "257, MediaMarkt Köln-Kalk (in den Köln-Arcaden)",
    "259, MediaMarkt Bremen (Waterfront)",
    "260, MediaMarkt Hamburg-Altona (im Bahnhof Altona)",
    "261, MediaMarkt Peine",
    "262, MediaMarkt Berlin-Prenzlauer Berg (Ecke Ostseestraße)",
    "263, MediaMarkt Karlsruhe - Ettlinger Tor",
    "264, MediaMarkt Deggendorf",
    "265, MediaMarkt Traunreut",
    "266, MediaMarkt Erfurt T.E.C. (im T.E.C.)",
    "267, MediaMarkt Gießen",
    "268, MediaMarkt Neustadt an der Weinstraße",
    "269, MediaMarkt Mönchengladbach",
    "270, MediaMarkt Berlin-Steglitz Im Schloss",
    "271, MediaMarkt Duisburg-Großenbaum",
    "272, MediaMarkt Bad Neustadt",
    "273, MediaMarkt Würzburg-Dürrbachau",
    "274, MediaMarkt Meerane",
    "275, MediaMarkt Buchholz in der Nordheide",
    "278, MediaMarkt Dietzenbach",
    "279, MediaMarkt Eschweiler",
    "280, MediaMarkt Papenburg",
    "376, MediaMarkt Neuss",
    "377, MediaMarkt Düsseldorf-Bilk Arcaden (Ecke Bachstraße)",
    "378, MediaMarkt Holzminden",
    "381, MediaMarkt Erding (im West Erding Park)",
    "382, MediaMarkt Halberstadt",
    "401, MediaMarkt Regensburg",
    "402, MediaMarkt Stuttgart-Feuerbach",
    "403, MediaMarkt Bochum-Ruhrpark",
    "404, MediaMarkt Berlin-Waltersdorf",
    "405, MediaMarkt Mülheim",
    "406, MediaMarkt Berlin-Wedding",
    "407, MediaMarkt Nürnberg-Kleinreuth",
    "408, MediaMarkt Erlangen",
    "409, MediaMarkt Erfurt im Thüringen Park",
    "410, MediaMarkt Ludwigshafen-Oggersheim (im Einkaufspark Oggersheim)",
    "411, MediaMarkt Wolfsburg",
    "412, MediaMarkt Berlin-Spandau",
    "414, MediaMarkt Kempten-Allgäu",
    "415, MediaMarkt München-Euroindustriepark",
    "416, MediaMarkt Aschaffenburg",
    "417, MediaMarkt Passau",
    "418, MediaMarkt Mainz",
    "419, MediaMarkt Egelsbach",
    "420, MediaMarkt Kaiserslautern",
    "421, MediaMarkt Freiburg",
    "422, MediaMarkt Reutlingen",
    "423, MediaMarkt Zwickau",
    "424, MediaMarkt Essen",
    "425, MediaMarkt Duisburg-Marxloh",
    "426, MediaMarkt Belm-Osnabrück",
    "427, MediaMarkt Paderborn (im Südring-Einkaufscenter)",
    "428, MediaMarkt Bremerhaven Schiffdorf-Spaden",
    "429, MediaMarkt Rostock-Sievershagen",
    "430, MediaMarkt Günthersdorf",
    "431, MediaMarkt Braunschweig",
    "432, MediaMarkt Mannheim-Neckarau",
    "434, MediaMarkt Herzogenrath",
    "436, MediaMarkt Rosenheim",
    "437, MediaMarkt Straubing",
    "438, MediaMarkt Hallstadt-Bamberg",
    "439, MediaMarkt Würzburg",
    "440, MediaMarkt Schwentinental",
    "441, MediaMarkt Kiel",
    "442, MediaMarkt Hamburg-Nedderfeld",
    "443, MediaMarkt Pirmasens",
    "444, MediaMarkt Pforzheim",
    "445, MediaMarkt Porta Westfalica (Minden)",
    "446, MediaMarkt Bielefeld",
    "447, MediaMarkt Frankfurt-Nordwestzentrum",
    "448, MediaMarkt Fulda am Emaillierwerk",
    "449, MediaMarkt Halle-Peißen",
    "450, MediaMarkt Ludwigsburg",
    "453, MediaMarkt Recklinghausen",
    "454, MediaMarkt Bremen (Weserpark)",
    "455, MediaMarkt Lüneburg",
    "456, MediaMarkt Neu-Ulm",
    "457, MediaMarkt Bischofsheim",
    "458, MediaMarkt Saarbrücken-Saarbasar",
    "459, MediaMarkt Berlin-Neukölln in den Neukölln-Arcaden",
    "460, MediaMarkt Dresden-Kaufpark",
    "461, MediaMarkt München-Solln",
    "462, MediaMarkt Hildesheim",
    "463, MediaMarkt Göttingen",
    "464, MediaMarkt Esslingen",
    "465, MediaMarkt Koblenz",
    "466, MediaMarkt Ingolstadt",
    "467, MediaMarkt Hof",
    "469, MediaMarkt Hamburg-Billstedt",
    "470, MediaMarkt Potsdam Im Sterncenter",
    "471, MediaMarkt Landshut",
    "472, MediaMarkt Bad Dürrheim",
    "473, MediaMarkt Ravensburg",
    "474, MediaMarkt Köln-Marsdorf",
    "475, MediaMarkt Lübeck",
    "476, MediaMarkt Hamburg-Wandsbek",
    "477, MediaMarkt Worms (im WEP)",
    "478, MediaMarkt Schwedt (Oder Center Schwedt)",
    "479, MediaMarkt Sindelfingen (im Breuningerland)",
    "480, MediaMarkt Dresden-ElbePark",
    "481, MediaMarkt Magdeburg-Pfahlberg",
    "482, MediaMarkt München-Pasing",
    "483, MediaMarkt Berlin-Biesdorf",
    "485, MediaMarkt Kassel (DEZ Kassel)",
    "486, MediaMarkt Plauen",
    "487, MediaMarkt Schweinfurt",
    "488, MediaMarkt Krefeld",
    "490, MediaMarkt Stralsund (im Strelapark EKZ)",
    "491, MediaMarkt Hameln",
    "492, MediaMarkt Chemnitz-Sachsenallee (im EKZ Sachsenallee)",
    "493, MediaMarkt Nürnberg-Langwasser",
    "494, MediaMarkt Offenburg",
    "495, MediaMarkt Lahr",
    "496, MediaMarkt München-Haidhausen",
    "497, MediaMarkt Leipzig-Paunsdorf (im Paunsdorf-Center)",
    "498, MediaMarkt Halstenbek",
    "500, MediaMarkt Neubrandenburg",
    "501, MediaMarkt Schwerin (im Schloßpark-Center)",
    "502, MediaMarkt Konstanz",
    "503, MediaMarkt Ansbach",
    "505, MediaMarkt Bruchsal",
    "506, MediaMarkt Augsburg-Oberhausen",
    "507, MediaMarkt Münster (im Gewerbegebiet Süd)",
    "508, MediaMarkt Chemnitz-Röhrsdorf (im Chemnitz-Center)",
    "509, MediaMarkt Flensburg",
    "510, MediaMarkt Berlin-Tegel in den Borsighallen",
    "511, MediaMarkt Neumünster",
    "514, MediaMarkt Aschaffenburg-City (City-Galerie)",
    "515, MediaMarkt Würzburg-City",
    "516, MediaMarkt Nordhorn",
    "517, MediaMarkt Schwäbisch Gmünd",
    "519, MediaMarkt Nagold",
    "521, MediaMarkt Kirchheim (im Nanz Center)",
    "522, MediaMarkt Schorndorf",
    "523, MediaMarkt Schwäbisch Hall",
    "525, MediaMarkt Crailsheim",
    "526, MediaMarkt Aalen",
    "527, MediaMarkt Heilbronn (am Europaplatz)",
    "529, MediaMarkt Backnang",
    "530, MediaMarkt Mosbach",
    "531, MediaMarkt Sinsheim",
    "532, MediaMarkt Eislingen",
    "534, MediaMarkt Karlsruhe - Bulach",
    "538, MediaMarkt Viernheim",
    "539, MediaMarkt Köln City am Dom",
    "540, MediaMarkt Neuwied",
    "541, MediaMarkt Cottbus",
    "542, MediaMarkt Hannover-Vahrenheide",
    "543, MediaMarkt Jena",
    "544, MediaMarkt Albstadt",
    "545, MediaMarkt Hamburg-Hummelsbüttel",
    "546, MediaMarkt Heppenheim",
    "547, MediaMarkt Hannover-Wülfel",
    "548, MediaMarkt Coburg",
    "549, MediaMarkt Homburg (im Saarpfalz-Center)",
    "550, MediaMarkt Velbert",
    "551, MediaMarkt Bad Kreuznach",
    "552, MediaMarkt Main-Taunus-Zentrum",
    "553, MediaMarkt Zella-Mehlis",
    "554, MediaMarkt Trier  (Alleencenter direkt am Hbf)",
    "555, MediaMarkt Frankfurt-Borsigallee",
    "556, MediaMarkt Buxtehude",
    "558, MediaMarkt Augsburg-Göggingen",
    "559, MediaMarkt Goslar",
    "560, MediaMarkt Rheine",
    "561, MediaMarkt Heide (im Gewerbegebiet Ost)",
    "562, MediaMarkt Landau",
    "563, MediaMarkt Weiterstadt",
    "564, MediaMarkt Greifswald",
    "565, MediaMarkt Rostock-Brinckmansdorf",
    "566, MediaMarkt Singen",
    "567, MediaMarkt Lingen",
    "568, MediaMarkt Wuppertal",
    "569, MediaMarkt Magdeburg-Bördepark",
    "570, MediaMarkt Friedrichshafen (im Bodensee-Center)",
    "571, MediaMarkt Limburg",
    "572, MediaMarkt Ulm",
    "573, MediaMarkt Saarbrücken auf den Saarterrassen",
    "574, MediaMarkt Gütersloh (ggü. der Feuerwehr)",
    "575, MediaMarkt Nürnberg-Schoppershof (im MERCADO Center)",
    "576, MediaMarkt Wiesbaden-Hasengarten",
    "577, MediaMarkt Heidelberg-Rohrbach (im Einkaufszentrum)",
    "578, MediaMarkt Berlin-Schöneweide im Zentrum Schöneweide",
    "579, MediaMarkt Mühldorf am Inn",
    "581, MediaMarkt Marburg",
    "582, MediaMarkt Gründau-Lieblos",
    "583, MediaMarkt Weilheim",
    "584, MediaMarkt Memmingen",
    "585, MediaMarkt Donauwörth",
    "587, MediaMarkt Marktredwitz",
    "588, MediaMarkt Weiden",
    "589, MediaMarkt Dessau",
    "590, MediaMarkt Nienburg",
    "591, MediaMarkt Mannheim-Sandhofen",
    "593, MediaMarkt Idar-Oberstein (im Gewerbepark Nahetal)",
    "594, MediaMarkt Hamburg-Harburg",
    "595, MediaMarkt Hückelhoven",
    "624, MediaMarkt Landsberg am Lech",
    "649, MediaMarkt Dresden Centrum-Galerie",
    "798, MediaMarkt Wiesbaden-Äppelallee",
    "1172, MediaMarkt Hamburg-Oststeinbek",
    "1173, MediaMarkt Neutraubling",
    "1182, MediaMarkt Dortmund Indupark",
    "1183, MediaMarkt Elmshorn",
    "1184, MediaMarkt Wilhelmshaven",
    "1189, MediaMarkt Riesa",
    "1201, MediaMarkt Schwabach",
    "1212, MediaMarkt Stadthagen",
    "1229, MediaMarkt Leipzig Höfe am Brühl",
    "1231, MediaMarkt Kulmbach",
    "1232, MediaMarkt Dorsten",
    "1233, MediaMarkt Lippstadt",
    "1247, MediaMarkt Neuburg an der Donau",
    "1248, MediaMarkt Nördlingen",
    "1254, MediaMarkt Amberg",
    "1287, MediaMarkt Karlsfeld",
    "1307, MediaMarkt Gifhorn",
    "1309, MediaMarkt Bonn",
    "1334, MediaMarkt Eisenach",
    "1350, MediaMarkt Stuttgart Milaneo",
    "1392, MediaMarkt Neumarkt",
    "1397, MediaMarkt Leinfelden-Echterdingen",
    "1400, MediaMarkt Nordhausen",
    "1443, MediaMarkt Salzgitter",
    "1465, MediaMarkt Berlin-Hauptbahnhof",
    "1466, MediaMarkt Böblingen (im EKZ Mercaden)",
    "1775, MediaMarkt Dortmund-Hörde",
    "1776, MediaMarkt Weinheim",
    "1787, MediaMarkt Schweinfurt City",
    "1826, MediaMarkt Bornheim",
    "1841, MediaMarkt Burghausen",
    "1878, MediaMarkt Forchheim",
    "1964, MediaMarkt Leer",
    "6058, MediaMarkt Bergisch Gladbach"
  ]
}

About

Automatically browses the "MediaMarkt Fundgrube" in your town and sends new products via Telegram.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published