en.parkopedia.sg
robots.txt
Robots Exclusion Standard data for en.parkopedia.sg
Resource Scan
Scan Details
Site Domain | en.parkopedia.sg |
Base Domain | parkopedia.sg |
Scan Status | Ok |
Last Scan | 2024-11-03T15:53:15+00:00 |
Next Scan | 2024-12-03T15:53:15+00:00 |
Last Scan
Scanned | 2024-11-03T15:53:15+00:00 |
URL | https://en.parkopedia.sg/robots.txt |
Domain IPs | 52.223.3.218, 76.223.121.117 |
Response IP | 52.223.3.218 |
Found | Yes |
Hash | 2217f8687d3480c657cf41585b8fb243b240eb3c9ef308d2e8ef6c71b8eba03d |
SimHash | 137549c1c5c0 |
Groups
baiduspider
baiduspider-video
baiduspider-image
baiduspider-render
baiduspider-news
baiduspider-favo
baiduspider-ads
baiduspider-cpro
baiduspider+
ai2bot
ai2bot-dolma
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
imagesiftbot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
webzio-extended
youbot
anthropic-ai
cohere-ai
facebookexternalhit
iaskspider/2.0
img2dataset
omgili
omgilibot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /transfer |
Disallow | /book |
Disallow | /feed/ |
Disallow | /ma/ |
Disallow | /review |
Disallow | /protected/ |
Disallow | /api/ |
Disallow | /location-not-found |
Disallow | /auth |
Disallow | /users |
Disallow | /console |
Disallow | /consolev2 |
Disallow | /markercode |
Disallow | /adminassistants |
Disallow | /locations |
Disallow | /bookings |
Disallow | /clp |
Disallow | /autocomplete |