weldersadvice.com
robots.txt

Robots Exclusion Standard data for weldersadvice.com

Resource Scan

Scan Details

Site Domain weldersadvice.com
Base Domain weldersadvice.com
Scan Status Ok
Last Scan2024-10-02T22:39:01+00:00
Next Scan 2024-10-09T22:39:01+00:00

Last Scan

Scanned2024-10-02T22:39:01+00:00
URL https://weldersadvice.com/robots.txt
Domain IPs 104.21.49.181, 172.67.165.134, 2606:4700:3032::6815:31b5, 2606:4700:3033::ac43:a586
Response IP 104.21.49.181
Found Yes
Hash 97c5f6bb52c5e76cdcfe27c369c52e90312cba90d7fd68d741c3d1a92c6dcf01
SimHash 62714b0272c1

Groups

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /*/feed
Disallow /?p=*
Disallow /search?
Disallow /?s=*
Disallow /*/?s=*%5C
Disallow /trackback/
Disallow /*/trackback
Disallow /*/comments
Disallow /comments/
Disallow /*/?pk_campaign=*
Disallow /cdn-cgi/*
Disallow /*/*.js?gcb=*
Disallow /beardeddragon/
Disallow /detroitchicago/
Disallow /porpoiseant/
Disallow /1254144%2C22875419475/

Other Records

Field Value
sitemap https://weldersadvice.com/sitemap_index.xml