python - scraping bigger websites and getting results to input- is this the correct process?

Question

yall! This isn't about specific code (just yet, don't worry I'll be back), but I'm trying to go about learning what I need to make the website I want. I know some python,/HTML/CSS, but here is the kind of website I want, and below what think I need to do, and questions beyond my grasp rn. lol.

I want to create a website that scrapes a makeup website for specific ingredients and returns either a 'yes this is safe' or 'no this isn't safe' based on the spider scraping for few keyword ingredients.

So far I've been learning scrapy, but since the website, I want to use (Sephora) has thousands of products all on different pages, I'm not exactly sure how to code the spider since every item is on a different page. is that even doable? (I have successfully scaped certain website pages so YAY ME)

I'm assuming I can use an IF/ELSE statement to return a certain text block in a table on the website if it finds the keywords? Would this be the correct way to make the website? thoughts/feedback appreciated, thank yall!

question from:https://stackoverflow.com/questions/66055195/scraping-bigger-websites-and-getting-results-to-input-is-this-the-correct-proce

Answer 1

Waitting for answers