1. 为什么需要专门的中文搜索方案在Laravel项目中实现中文搜索一直是个痛点。MySQL的LIKE查询不仅效率低下而且无法处理中文分词的问题。比如搜索冬季奥运会时标准分析器会把每个汉字拆分开来导致搜索结果不准确。Elasticsearch作为专业的搜索引擎通过特定的分词插件可以完美解决这个问题。我最近在一个电商项目中就遇到了这个需求商品名称和描述需要支持中文搜索而且搜索结果要能按相关度排序。经过多次尝试最终确定了LaravelElasticsearchIK分词器的技术方案。2. 环境准备与安装2.1 Elasticsearch安装与配置首先需要在服务器上安装Elasticsearch。推荐使用7.x以上版本因为对中文支持更好。在Ubuntu上安装很简单wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add - sudo apt-get install apt-transport-https echo deb https://artifacts.elastic.co/packages/7.x/apt stable main | sudo tee -a /etc/apt/sources.list.d/elastic-7.x.list sudo apt-get update sudo apt-get install elasticsearch安装完成后需要修改配置文件/etc/elasticsearch/elasticsearch.ymlcluster.name: my-application network.host: 0.0.0.0 http.port: 9200 discovery.type: single-node然后启动服务sudo systemctl start elasticsearch sudo systemctl enable elasticsearch2.2 IK分词器安装Elasticsearch默认的分词器对中文不友好我们需要安装IK分词器cd /usr/share/elasticsearch/bin sudo ./elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.17.3/elasticsearch-analysis-ik-7.17.3.zip安装后需要重启Elasticsearchsudo systemctl restart elasticsearch可以通过以下命令测试IK分词器是否工作正常curl -X POST localhost:9200/_analyze -H Content-Type: application/json -d { analyzer: ik_max_word, text: 中华人民共和国 } 应该能看到正确的分词结果。3. Laravel项目集成3.1 安装必要的PHP包在Laravel项目中我们需要安装elasticsearch/elasticsearch和laravel/scoutcomposer require elasticsearch/elasticsearch composer require laravel/scout然后发布Scout的配置文件php artisan vendor:publish --providerLaravel\Scout\ScoutServiceProvider在config/scout.php中配置Elasticsearch连接elasticsearch [ index env(ELASTICSEARCH_INDEX, laravel), hosts [ env(ELASTICSEARCH_HOST, http://localhost:9200), ], ],3.2 模型配置假设我们要对Product模型建立搜索索引首先需要在模型中引入Searchable traituse Laravel\Scout\Searchable; class Product extends Model { use Searchable; public function toSearchableArray() { return [ id $this-id, name $this-name, description $this-description, price $this-price, ]; } }3.3 创建索引映射为了让Elasticsearch正确处理中文我们需要为索引创建自定义映射use Elasticsearch\ClientBuilder; $client ClientBuilder::create()-setHosts([env(ELASTICSEARCH_HOST)])-build(); $params [ index products, body [ settings [ analysis [ analyzer [ ik_analyzer [ type custom, tokenizer ik_max_word, filter [lowercase] ] ] ] ], mappings [ properties [ name [ type text, analyzer ik_analyzer, search_analyzer ik_analyzer ], description [ type text, analyzer ik_analyzer, search_analyzer ik_analyzer ], price [ type float ] ] ] ] ]; $response $client-indices()-create($params);4. 实现中文搜索功能4.1 数据索引在数据量不大的情况下可以直接使用Scout提供的命令创建索引php artisan scout:import App\Models\Product对于大数据量建议分批处理Product::chunk(500, function ($products) { $products-searchable(); });4.2 基本搜索实现在控制器中实现搜索功能public function search(Request $request) { $query $request-input(q); $products Product::search($query) -where(price, , 0) -orderBy(price, desc) -paginate(10); return view(products.search, compact(products, query)); }4.3 高级搜索功能如果需要更复杂的搜索条件可以直接使用Elasticsearch的DSL查询$params [ index products, body [ query [ bool [ must [ [match [ name [ query $query, operator and ] ]], [range [ price [ gte $minPrice, lte $maxPrice ] ]] ] ] ], highlight [ fields [ name new \stdClass(), description new \stdClass() ] ] ] ]; $response $client-search($params);5. 性能优化与问题排查5.1 索引优化对于中文搜索合理的索引设置可以大幅提升性能settings [ number_of_shards 3, number_of_replicas 1, analysis [ analyzer [ ik_analyzer [ type custom, tokenizer ik_max_word, filter [lowercase, stop, trim] ] ], filter [ stop [ type stop, stopwords [的, 了, 和] ] ] ] ]5.2 常见问题解决分词不准确可以通过扩展IK分词器的词典来解决。在config/analysis-ik/目录下添加自定义词典。搜索结果不符合预期检查查询时使用的分析器是否和索引时一致。可以使用Explain API分析查询过程curl -X GET localhost:9200/products/_explain/1 -H Content-Type: application/json -d { query : { match : { name : 手机 } } } 索引速度慢可以调整refresh_interval参数settings [ refresh_interval 30s ]6. 实际应用案例在我最近开发的电商平台中实现了以下搜索功能智能提示使用Elasticsearch的Completion Suggester实现mappings [ properties [ name_suggest [ type completion ] ] ]同义词搜索通过配置同义词过滤器filter [ my_synonym [ type synonym, synonyms [ 手机, 智能手机, 移动电话, 电脑, 计算机, 笔记本 ] ] ]搜索结果高亮$params [ body [ query [...], highlight [ pre_tags [em classhighlight], post_tags [/em], fields [ name new \stdClass(), description new \stdClass() ] ] ] ];7. 维护与监控7.1 索引维护定期优化索引curl -X POST localhost:9200/products/_optimize?max_num_segments1监控索引状态curl -X GET localhost:9200/_cat/indices?v7.2 性能监控使用Elasticsearch的监控APIcurl -X GET localhost:9200/_nodes/stats?pretty对于生产环境建议安装Kibana进行可视化监控。8. 扩展思考多语言支持如果需要支持多种语言可以设置多字段映射mappings [ properties [ title [ type text, fields [ zh [ type text, analyzer ik_analyzer ], en [ type text, analyzer english ] ] ] ] ]搜索结果排序可以根据业务需求自定义排序规则body [ query [...], sort [ [price [order desc]], _score ] ]分布式部署对于大型应用需要考虑Elasticsearch集群部署cluster.name: my-cluster node.name: node-1 discovery.seed_hosts: [host1, host2] cluster.initial_master_nodes: [node-1, node-2]
1. 为什么需要专门的中文搜索方案在Laravel项目中实现中文搜索一直是个痛点。MySQL的LIKE查询不仅效率低下而且无法处理中文分词的问题。比如搜索冬季奥运会时标准分析器会把每个汉字拆分开来导致搜索结果不准确。Elasticsearch作为专业的搜索引擎通过特定的分词插件可以完美解决这个问题。我最近在一个电商项目中就遇到了这个需求商品名称和描述需要支持中文搜索而且搜索结果要能按相关度排序。经过多次尝试最终确定了LaravelElasticsearchIK分词器的技术方案。2. 环境准备与安装2.1 Elasticsearch安装与配置首先需要在服务器上安装Elasticsearch。推荐使用7.x以上版本因为对中文支持更好。在Ubuntu上安装很简单wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add - sudo apt-get install apt-transport-https echo deb https://artifacts.elastic.co/packages/7.x/apt stable main | sudo tee -a /etc/apt/sources.list.d/elastic-7.x.list sudo apt-get update sudo apt-get install elasticsearch安装完成后需要修改配置文件/etc/elasticsearch/elasticsearch.ymlcluster.name: my-application network.host: 0.0.0.0 http.port: 9200 discovery.type: single-node然后启动服务sudo systemctl start elasticsearch sudo systemctl enable elasticsearch2.2 IK分词器安装Elasticsearch默认的分词器对中文不友好我们需要安装IK分词器cd /usr/share/elasticsearch/bin sudo ./elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.17.3/elasticsearch-analysis-ik-7.17.3.zip安装后需要重启Elasticsearchsudo systemctl restart elasticsearch可以通过以下命令测试IK分词器是否工作正常curl -X POST localhost:9200/_analyze -H Content-Type: application/json -d { analyzer: ik_max_word, text: 中华人民共和国 } 应该能看到正确的分词结果。3. Laravel项目集成3.1 安装必要的PHP包在Laravel项目中我们需要安装elasticsearch/elasticsearch和laravel/scoutcomposer require elasticsearch/elasticsearch composer require laravel/scout然后发布Scout的配置文件php artisan vendor:publish --providerLaravel\Scout\ScoutServiceProvider在config/scout.php中配置Elasticsearch连接elasticsearch [ index env(ELASTICSEARCH_INDEX, laravel), hosts [ env(ELASTICSEARCH_HOST, http://localhost:9200), ], ],3.2 模型配置假设我们要对Product模型建立搜索索引首先需要在模型中引入Searchable traituse Laravel\Scout\Searchable; class Product extends Model { use Searchable; public function toSearchableArray() { return [ id $this-id, name $this-name, description $this-description, price $this-price, ]; } }3.3 创建索引映射为了让Elasticsearch正确处理中文我们需要为索引创建自定义映射use Elasticsearch\ClientBuilder; $client ClientBuilder::create()-setHosts([env(ELASTICSEARCH_HOST)])-build(); $params [ index products, body [ settings [ analysis [ analyzer [ ik_analyzer [ type custom, tokenizer ik_max_word, filter [lowercase] ] ] ] ], mappings [ properties [ name [ type text, analyzer ik_analyzer, search_analyzer ik_analyzer ], description [ type text, analyzer ik_analyzer, search_analyzer ik_analyzer ], price [ type float ] ] ] ] ]; $response $client-indices()-create($params);4. 实现中文搜索功能4.1 数据索引在数据量不大的情况下可以直接使用Scout提供的命令创建索引php artisan scout:import App\Models\Product对于大数据量建议分批处理Product::chunk(500, function ($products) { $products-searchable(); });4.2 基本搜索实现在控制器中实现搜索功能public function search(Request $request) { $query $request-input(q); $products Product::search($query) -where(price, , 0) -orderBy(price, desc) -paginate(10); return view(products.search, compact(products, query)); }4.3 高级搜索功能如果需要更复杂的搜索条件可以直接使用Elasticsearch的DSL查询$params [ index products, body [ query [ bool [ must [ [match [ name [ query $query, operator and ] ]], [range [ price [ gte $minPrice, lte $maxPrice ] ]] ] ] ], highlight [ fields [ name new \stdClass(), description new \stdClass() ] ] ] ]; $response $client-search($params);5. 性能优化与问题排查5.1 索引优化对于中文搜索合理的索引设置可以大幅提升性能settings [ number_of_shards 3, number_of_replicas 1, analysis [ analyzer [ ik_analyzer [ type custom, tokenizer ik_max_word, filter [lowercase, stop, trim] ] ], filter [ stop [ type stop, stopwords [的, 了, 和] ] ] ] ]5.2 常见问题解决分词不准确可以通过扩展IK分词器的词典来解决。在config/analysis-ik/目录下添加自定义词典。搜索结果不符合预期检查查询时使用的分析器是否和索引时一致。可以使用Explain API分析查询过程curl -X GET localhost:9200/products/_explain/1 -H Content-Type: application/json -d { query : { match : { name : 手机 } } } 索引速度慢可以调整refresh_interval参数settings [ refresh_interval 30s ]6. 实际应用案例在我最近开发的电商平台中实现了以下搜索功能智能提示使用Elasticsearch的Completion Suggester实现mappings [ properties [ name_suggest [ type completion ] ] ]同义词搜索通过配置同义词过滤器filter [ my_synonym [ type synonym, synonyms [ 手机, 智能手机, 移动电话, 电脑, 计算机, 笔记本 ] ] ]搜索结果高亮$params [ body [ query [...], highlight [ pre_tags [em classhighlight], post_tags [/em], fields [ name new \stdClass(), description new \stdClass() ] ] ] ];7. 维护与监控7.1 索引维护定期优化索引curl -X POST localhost:9200/products/_optimize?max_num_segments1监控索引状态curl -X GET localhost:9200/_cat/indices?v7.2 性能监控使用Elasticsearch的监控APIcurl -X GET localhost:9200/_nodes/stats?pretty对于生产环境建议安装Kibana进行可视化监控。8. 扩展思考多语言支持如果需要支持多种语言可以设置多字段映射mappings [ properties [ title [ type text, fields [ zh [ type text, analyzer ik_analyzer ], en [ type text, analyzer english ] ] ] ] ]搜索结果排序可以根据业务需求自定义排序规则body [ query [...], sort [ [price [order desc]], _score ] ]分布式部署对于大型应用需要考虑Elasticsearch集群部署cluster.name: my-cluster node.name: node-1 discovery.seed_hosts: [host1, host2] cluster.initial_master_nodes: [node-1, node-2]
实战：小样本时序建模与Python工程实现)
