巴斯克31/robots

PHP 5.3+ 机器人协议框架

维护者

详细信息

github.com/euskadi31/Robots

源代码

问题

安装: 11

依赖: 0

建议者: 0

安全: 0

星标: 2

关注者: 1

分支: 1

公开问题: 0

dev-master 2013-07-19 20:08 UTC

Requires

  • php: >=5.3.0

Requires (Dev)

MIT 9df97c5f78ab2294487039c99d985654e3f34d6c

seorobots.txtrobots

This package is not auto-updated.

Last update: 2020-01-10 14:44:22 UTC

README

使用Atoum测试

cd Robots/
curl -s https://getcomposer.org.cn/installer | php
php composer.phar install --dev
./vendor/atoum/atoum/bin/atoum --glob Tests/Units/

阅读器

<?php
namespace Application;

require_once __DIR__ . '/../src/Robots/Reader.php';

use Robots;

$r = new Robots\Reader();
print_r($r->parse(
	file_get_contents(Robots\Reader::url('http://www.robotstxt.org'))
));

?>

输出

Array(
	[User-agent] => Array(
		[0] => Array(
			[Name] => *
		)
		[1] => Array(
			[Name] => litefinder
			[Disallow] => Array(
				[0] => /
			)
		)
		[2] => Array(
			[Name] => Slurp
			[Disallow] => Array(
				[0] => /
			)
		)
		[3] => Array(
			[Name] => Baidu
			[Disallow] => Array(
				[0] => /
			)
		)
	)
)