vrkansagara / common-crawler
此软件包已被废弃,不再维护。未建议替代软件包。
通用爬虫
1.0.2
2018-01-22 21:06 UTC
Requires
- php: >=5.6
- zendframework/zendframework: 2.*
This package is not auto-updated.
Last update: 2021-11-13 14:42:49 UTC
README
基于 PHP
和 Zend Framework
的通用爬虫库
如何从网页运行!
<<项目 URL>>/commoncrawler
如何从控制台运行!
php public/index.php commooncrawler
下载 / 安装
composer require vrkansagara/common-crawl
演示
https://vrkansagara.in/commoncrawler
SQL
CREATE TABLE `common_index` ( `id` int(11) NOT NULL, `cindex` varchar(25) NOT NULL, `name` varchar(20) NOT NULL, `timegate` varchar(50) NOT NULL, `cdx_api` varchar(55) NOT NULL, `status` tinyint(1) NOT NULL DEFAULT '0', `created_at` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP, `updated_at` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00' ON UPDATE CURRENT_TIMESTAMP ) ENGINE=InnoDB DEFAULT CHARSET=utf8;
SQLite
CREATE TABLE common_index
(
id INTEGER PRIMARY KEY AUTOINCREMENT NOT NULL,
"index" VARCHAR(25) NOT NULL,
name VARCHAR(20) NOT NULL,
timegate VARCHAR(50) NOT NULL,
cdx_api VARCHAR(55) NOT NULL
);
遵循路径,跟随大师,与大师同行,看透大师,成为大师。