webdesign-inspiration.com
robots.txt

Robots Exclusion Standard data for webdesign-inspiration.com

Resource Scan

Scan Details

Site Domain webdesign-inspiration.com
Base Domain webdesign-inspiration.com
Scan Status Ok
Last Scan2024-10-05T12:29:37+00:00
Next Scan 2024-10-12T12:29:37+00:00

Last Scan

Scanned2024-10-05T12:29:37+00:00
URL https://webdesign-inspiration.com/robots.txt
Redirect https://www.webdesign-inspiration.com/robots.txt
Redirect Domain www.webdesign-inspiration.com
Redirect Base webdesign-inspiration.com
Domain IPs 104.26.4.20, 104.26.5.20, 172.67.70.27, 2606:4700:20::681a:414, 2606:4700:20::681a:514, 2606:4700:20::ac43:461b
Redirect IPs 104.26.4.20, 104.26.5.20, 172.67.70.27, 2606:4700:20::681a:414, 2606:4700:20::681a:514, 2606:4700:20::ac43:461b
Response IP 104.26.4.20
Found Yes
Hash 95006758cacb1ecbd6c5a8aaa4e282cc5f32114d01aa32a43da620d4099f7ee8
SimHash 4220c9534532

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.webdesign-inspiration.com/sitemap.xml
sitemap https://www.webdesign-inspiration.com/blog/sitemap-posttype-page.xml
sitemap https://www.webdesign-inspiration.com/blog/sitemap-posttype-post.xml
sitemap https://www.webdesign-inspiration.com/blog/sitemap-posttype-reviews.xml
sitemap https://www.webdesign-inspiration.com/blog/sitemap-posttype-conferences.xml
sitemap https://www.webdesign-inspiration.com/blog/sitemap-posttype-deals.xml