Error when Log In

[yhngr]

Hello,

I don't know if I'm doing something wrong ( probably )

If you can help me thanks a lot !

[BenSouchet]

Hi,
The steps to properly pass the current Cloudflare restrictions can seems weird.

The steps are:

• open your favorite web browser normally, go to https://www.cardmarket.com/en
• Wait until you pass the Cloudflare protection and landed on the website
• Now you can, from your terminal, start cw-wizard with:
  python3 cw-wizard-gui.py
• The interface will ask for the name of your web browser, the one you used to open the Cardmarket website url in the previous step (should be chrome If you used Google Chrome, firefox if you used Mozilla Firefox,…)

If you still got the same 403 message, retry the described steps but first ensure all Cardmarket tabs are closed from your web browser (really important).

Normally in 1/2 try this will work.

When it’s working you can use cw-wizard-gui.py for 30mins/1hour without redoing the steps of opening the Cardmarket website on your web browser.

Let me know if after testing these steps you are still blocked, by the way which web browser are you using? (I only tested with Chrome and Firefox but this should work with all browsers)

[yhngr]

Hello ! Thanks for the answer !

i've try on Opera first and Chrome in second but still don't work for me

I'm waiting for the cloudflare finish...etc but still have the 403 error

I've desactivate 2FA..etc

[BenSouchet]

@yhngr I can reproduce the issue, currently investigating 🕵️

[yhngr]

Thanks a lot ! You are amazing ! Hope you will find something

it's too boring to have to go through the site's wizard system directly, or manually select the best vendor..etc x)

[BenSouchet]

I just published a new version fixing the issue.

It's now require to pass the User-Agent in addition to the browser name (this is due to the increased protection set by Cloudflare).

I updated the README page, but in summary you need to open another tab in your browser and search for "my user agent", copy and pasting the value when requested by cw-wizard-gui.py.

User-Agent is a long string starting like: Mozilla/5.0 ...
After checking keep me informed if this is working on your side.

PS: I think is no more require to be logged-off before executing the script.

[yhngr]

yeah work with chromee but not with Opera apparently !

doesn't respond but I guess it's normal ! take a few minutes probably !

Thanks a lot !

[yhngr]

just got this error

the result

Don't understand if he finish or not to find the best

result on CM :

[BenSouchet]

yeah work with chromee but not with Opera apparently !

doesn't respond but I guess it's normal ! take a few minutes probably !

Thanks a lot !

Thanks for the responses, for this screen it's seems like a code issue, will investigate to fix that tomorrow (I think the code try to load more offers but there is no more offers to load for this card).

[BenSouchet]

just got this error

the result

Don't understand if he finish or not to find the best

result on CM :

If you got this message this means that the script made more than 5000 requests, this can happen start the script with lots of wantlists.

You will need to wait for 12h/24h to be able to reuse Cardmarket because you reach the maximum number of requests allowed per day.

No big deal, be reassured, but be aware that this is something that can happen.

[BenSouchet]

And last for the diff in the result, this is related to the limit of request that has been reached. The script don't crash but stop looking for cards so this is why you only have a partial result with the best candidate having only 9 cards you looking for.

When you will have access again to Cardmarket check and tell me what are the values you entered in you wantlist for the Buy Price.

So I can understand if it's a bug from the code or if it's normal but the values are too high and so load lots of offers (so perform more requests).

Edit / Hypothesis

Another possibility is that one (or more) card(s) in your wantlist is at a very low price (0.01€) and there this thousands of offers for this card at this very low price, you set a Buy Price of let says 1€ but this lead to 5000 offers available that are cheaper than the limit of 1€.
Since Cardmarket display 50 offers at a time, the will script require 100 requests to get the 5000 compatible offers.

Currently the script isn't limited in the number of offers to retrieve per card, if you didn't set a Buy Price the script only record the 50 lower offers meeting your criteria but if you set a Buy Price it look for all the available offers below this price, this can lead to lots of requests.

I should maybe set a limit of offers retrieved by card, to limit the number of requests and avoid getting quickly the too many requests error

[yhngr]

Okay I see thanks !

now i set a maximum price..etc

And got that

Apparently an language for the cards error

And the script "crash" doesn't respond

[BenSouchet]

@yhngr Thanks, I just released a new version that should fix the issues you mentioned.

[BenSouchet]

And just want to thank you 😊 for the time you spend to check and report the issues so I can improve the script.

[yhngr]

Thanks to you for ur work ! It's a pleasure aha ! If I can get better prices for the cards with your script, i'm not gonna say no ! And the better it work the better price I will get ! :') !

[yhngr]

Not responding and this attributeError don't really know ?

This is the want list with price..etc

[BenSouchet]

Will look into that, thanks for sharing the screen of the wantlist so I will be able to properly check the exact wantlist you have the issue with :)

[BenSouchet]

@yhngr Just published a new version.
I'm please to tell you that there is indeed better result with CW-Wizard than just using the Cardmarket one.

• Result of the best deals for minimum shipping of Cardmarket:

• Result of CW-Wizard:

I haven't checked in full details the difference, I let you tell me after testing it.

Edit

It seems there is a small bug in the list display when looking for the seller details:

The condition is override by the expansion and the language by the condition, it's purely visual, the card has been properly found with the correct asked parameters.

[yhngr]

Perfect I'm gonna test this ! thanks for your time !

[yhngr]

Btw can you show me a screen of the wishlist u made ? to see the price you put..etc ? I'm reaching limit at the end of the search

Thanks in advance

[BenSouchet]

Btw can you show me a screen of the wishlist u made ? to see the price you put..etc ? I'm reaching limit at the end of the search

Thanks in advance

I made the exact same wantlist as yours (same quantities, max price, languages, expansions):

Sometime the message for the limit reached is sent by Cardmarket, but for whatever reason, you can go to the cardmarket website (with your browser) and after that you can restart the script and this work.

For info: I checked and the script for the wantlist your shared do only 25 requests, so I think that the Too Many Requests error is not due to the number of requests (5000 per day per user) but maybe due to the time in seconds between requests.
I currently added 170ms of delay between requests (this is maybe not enough since we still get sometime the Too Many Requests Error)

[yhngr]

Okay why not aha ! Thanks perfect !

[BenSouchet]

Last info, currently the quantity value specified in wantlists isn't used by the script, dealing with that is a little bit tricky, I will maybe add the support for that in the future.