boredpanda.es
robots.txt

Robots Exclusion Standard data for boredpanda.es

Resource Scan

Scan Details

Site Domain boredpanda.es
Base Domain boredpanda.es
Scan Status Ok
Last Scan2024-11-10T18:04:47+00:00
Next Scan 2024-11-17T18:04:47+00:00

Last Scan

Scanned2024-11-10T18:04:47+00:00
URL https://boredpanda.es/robots.txt
Redirect https://www.boredpanda.es/robots.txt
Redirect Domain www.boredpanda.es
Redirect Base boredpanda.es
Domain IPs 3.227.37.61
Redirect IPs 13.226.2.127, 13.226.2.26, 13.226.2.53, 13.226.2.80
Response IP 18.165.122.16
Found Yes
Hash 485481ae328910331a1a0f86ccf27dfbc0d840510e39cc6d4d0ab4c51e1b509a
SimHash ceb47f81cbd1

Groups

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /*?utm_

*

Rule Path
Allow /
Disallow /*wp-admin/
Disallow /*wp-includes
Disallow /*wp-content
Disallow /*wp-json
Disallow /*?
Allow /*?comment
Allow /*?cexp_id=
Allow /*?show=trending
Allow /*?show=recent
Allow /*wp-includes*.jpg
Allow /*wp-content*.jpg
Allow /*wp-includes*.jpeg
Allow /*wp-content*.jpeg
Allow /*wp-includes*.jpe
Allow /*wp-content*.jpe
Allow /*wp-includes*.png
Allow /*wp-content*.png
Allow /*wp-includes*.css
Allow /*wp-content*.css
Allow /*wp-includes*.js
Allow /*wp-content*.js
Allow /*wp-includes*.gif
Allow /*wp-content*.gif
Allow /*wp-includes*.svg
Allow /*wp-content*.svg
Allow /*wp-includes*.webp
Allow /*wp-content*.webp
Allow /*?media_id

Other Records

Field Value
sitemap https://www.boredpanda.es/sitemap.xml
sitemap https://www.boredpanda.es/images-sitemap.xml
sitemap https://www.boredpanda.es/categories-sitemap.xml
sitemap https://www.boredpanda.es/news-sitemap.xml
sitemap https://www.boredpanda.es/authors-sitemap.xml