boredpanda.es
robots.txt

Robots Exclusion Standard data for boredpanda.es

Resource Scan

Scan Details

Site Domain boredpanda.es
Base Domain boredpanda.es
Scan Status Ok
Last Scan2024-05-19T01:45:53+00:00
Next Scan 2024-05-26T01:45:53+00:00

Last Scan

Scanned2024-05-19T01:45:53+00:00
URL https://boredpanda.es/robots.txt
Redirect https://www.boredpanda.es/robots.txt
Redirect Domain www.boredpanda.es
Redirect Base boredpanda.es
Domain IPs 3.227.37.61
Redirect IPs 18.164.154.34, 18.164.154.64, 18.164.154.7, 18.164.154.74
Response IP 108.157.60.18
Found Yes
Hash 06a9c9954b71c5200b26b246bfa7fbbbbbc4c2a29210bfd71385487570370ce7
SimHash cef46f814bd0

Groups

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /*wp-admin/
Disallow /*wp-includes
Disallow /*wp-content
Disallow /*wp-json
Disallow /*?
Allow /*?comment
Allow /*?cexp_id=
Allow /*?show=trending
Allow /*?show=recent
Allow /*wp-includes*.jpg
Allow /*wp-content*.jpg
Allow /*wp-includes*.jpeg
Allow /*wp-content*.jpeg
Allow /*wp-includes*.jpe
Allow /*wp-content*.jpe
Allow /*wp-includes*.png
Allow /*wp-content*.png
Allow /*wp-includes*.css
Allow /*wp-content*.css
Allow /*wp-includes*.js
Allow /*wp-content*.js
Allow /*wp-includes*.gif
Allow /*wp-content*.gif
Allow /*wp-includes*.svg
Allow /*wp-content*.svg
Allow /*wp-includes*.webp
Allow /*wp-content*.webp
Allow /*?media_id

Other Records

Field Value
sitemap https://www.boredpanda.es/sitemap.xml
sitemap https://www.boredpanda.es/images-sitemap.xml
sitemap https://www.boredpanda.es/categories-sitemap.xml
sitemap https://www.boredpanda.es/news-sitemap.xml
sitemap https://www.boredpanda.es/authors-sitemap.xml