scpt.ir
robots.txt

Robots Exclusion Standard data for scpt.ir

Resource Scan

Scan Details

Site Domain scpt.ir
Base Domain scpt.ir
Scan Status Ok
Last Scan2024-09-09T05:58:20+00:00
Next Scan 2024-10-09T05:58:20+00:00

Last Scan

Scanned2024-09-09T05:58:20+00:00
URL https://scpt.ir/robots.txt
Domain IPs 157.90.9.10
Response IP 157.90.9.10
Found Yes
Hash 5a1e5f4eaf4aef287a0d5bfbeeabbc76ffcbddb4d21c0c1feb402065780beccb
SimHash 2d51c3867714

Groups

*

Rule Path
Disallow /u/*
Disallow /workgroup/*

googlebot

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

googlebot-mobile

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

googlebot-image

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

mediapartners-google

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

adsbot-google

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

bingbot

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

yahoo-mmcrawler

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

gigabot

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

yahoo-blogs/v3.9

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

ninjabot

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

yandexdirect

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

yandexdirectdyn

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

yandeximages

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

yandexbot

Rule Path
Allow /
Disallow /u/*
Disallow /workgroup/*

Other Records

Field Value
sitemap http://scpt.ir/sitemap.xml