rodenastyle / stream-parser
PHP 多格式流式解析器
v2.0.1
2023-10-03 09:39 UTC
Requires
- php: >=7.1
- ext-xmlreader: *
- illuminate/collections: ^8.0|^9.0|^10.0
- maxakawizard/json-collection-parser: ^1.1
Requires (Dev)
- mockery/mockery: ^0.9.9
- phpunit/phpunit: ^6.0|^7.0|^8.0|^9.0
This package is auto-updated.
Last update: 2024-09-03 12:02:04 UTC
README
在解析 XML/CSV/JSON/... 文档时,有两种方法可以考虑
DOM 加载:加载整个文档,便于导航和解析,因此为开发者提供了最大的灵活性。
流式处理:意味着遍历文档,就像光标一样,在每个元素处停止,从而避免了内存过度消耗。
https://www.linkedin.com/pulse/processing-xml-documents-dom-vs-streaming-marius-ilina/
因此,在处理大文件时,回调将在文件下载的同时执行,在内存使用方面将更加高效。
安装
composer require rodenastyle/stream-parser
推荐使用
尽可能委托回调执行,以免阻塞文档读取
(基于 Laravel Queue 的示例)
use Illuminate\Support\Collection; StreamParser::xml("https://example.com/users.xml")->each(function(Collection $user){ dispatch(new App\Jobs\SendEmail($user)); });
实际输入/代码/输出演示
XML
<bookstore> <book ISBN="10-000000-001"> <title>The Iliad and The Odyssey</title> <price>12.95</price> <comments> <userComment rating="4"> Best translation I've read. </userComment> <userComment rating="2"> I like other versions better. </userComment> </comments> </book> [...] </bookstore>
use Illuminate\Support\Collection; StreamParser::xml("https://example.com/books.xml")->each(function(Collection $book){ var_dump($book); var_dump($book->get('comments')->toArray()); });
class Tightenco\Collect\Support\Collection#19 (1) {
protected $items =>
array(4) {
'ISBN' =>
string(13) "10-000000-001"
'title' =>
string(25) "The Iliad and The Odyssey"
'price' =>
string(5) "12.95"
'comments' =>
class Tightenco\Collect\Support\Collection#17 (1) {
protected $items =>
array(2) {
...
}
}
}
}
array(2) {
[0] =>
array(2) {
'rating' =>
string(1) "4"
'userComment' =>
string(27) "Best translation I've read."
}
[1] =>
array(2) {
'rating' =>
string(1) "2"
'userComment' =>
string(29) "I like other versions better."
}
}
此外,您还可以使用 ->withSeparatedParametersList()
来获取每个元素的参数,这些参数在 __params
属性上被分开。此外,->withoutSkippingFirstElement()
可以帮助解析第一个元素(通常是包含元素的元素)。
JSON
[ { "title": "The Iliad and The Odyssey", "price": 12.95, "comments": [ {"comment": "Best translation I've read."}, {"comment": "I like other versions better."} ] }, { "title": "Anthology of World Literature", "price": 24.95, "comments": [ {"comment": "Needs more modern literature."}, {"comment": "Excellent overview of world literature."} ] } ]
use Illuminate\Support\Collection; StreamParser::json("https://example.com/books.json")->each(function(Collection $book){ var_dump($book->get('comments')->count()); });
int(2)
int(2)
CSV
title,price,comments
The Iliad and The Odyssey,12.95,"Best translation I've read.,I like other versions better."
Anthology of World Literature,24.95,"Needs more modern literature.,Excellent overview of world literature."
use Illuminate\Support\Collection; StreamParser::csv("https://example.com/books.csv")->each(function(Collection $book){ var_dump($book->get('comments')->last()); });
string(29) "I like other versions better."
string(39) "Excellent overview of world literature."
许可证
此库在 MIT 许可下发布。