popsilla.com
robots.txt

Robots Exclusion Standard data for popsilla.com

Resource Scan

Scan Details

Site Domain popsilla.com
Base Domain popsilla.com
Scan Status Ok
Last Scan2024-05-23T01:56:43+00:00
Next Scan 2024-06-22T01:56:43+00:00

Last Scan

Scanned2024-05-23T01:56:43+00:00
URL https://popsilla.com/robots.txt
Redirect https://www.popsilla.com/robots.txt
Redirect Domain www.popsilla.com
Redirect Base popsilla.com
Domain IPs 104.16.122.115, 104.16.123.115, 2606:4700::6810:7a73, 2606:4700::6810:7b73
Redirect IPs 104.16.122.115, 104.16.123.115, 2606:4700::6810:7a73, 2606:4700::6810:7b73
Response IP 104.16.123.115
Found Yes
Hash 9d09a50bb46f710fd4ccf1b29641edb61a8654edfdf2abf5e029f5278e3b96f9
SimHash 581c4892ff50

Groups

*

Rule Path
Disallow /ja/free-line-stamp/*
Disallow /silla/
Disallow /pop-image/
Disallow /pop_file/

baiduspider*
sogou*

Rule Path
Disallow /

ahrefsbot
amazonbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
petalbot
photon
scrapy
semrushbot
linguee

Rule Path
Disallow /