文章目录
- 官网
- 版本
- 组件版本说明
- 实现代码地址
- es Spring Data Repositories
- 例子:
- ElasticsearchRepository分析
- es Spring Data Repositories 关键字
- es Spring Data Repositories client 加载
- rest风格客户端
- 直接执行dsl例子
- 响应式客户端-ReactiveElasticsearchClient
- pom.xml
- 例子
- ES 原生方式加载客户端
- pom.xml
- 加载原生客户端
- controller使用
- 验证结果
- 测试请求http文件-TestEs.http
- 外传
官网
https://www.elastic.co/cn/
整合springboot看上一篇文章
版本
一定要对应好版本,Elasticsearch 的不同版本变化是真大,
https://docs.spring.io/spring-data/elasticsearch/docs/4.4.10/reference/html/
组件版本说明
Springboot: 2.7.10
spring-data-elasticsearch: 4.4.10
spring-boot-starter-data-elasticsearch: 2.7.10
elasticsearch-java: 7.17.9
实现代码地址
https://github.com/OrderDong/microservice-boot
分支:microservice-boot-1.0.6-es
microservice-boot-eleastic模块
所有pom.xml引用
<!--elastic search 7.17.9 --><dependency><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-data-elasticsearch</artifactId></dependency><!--高版本单独使用elasticsearch client --><dependency><groupId>co.elastic.clients</groupId><artifactId>elasticsearch-java</artifactId><version>7.17.9</version></dependency><dependency><groupId>com.fasterxml.jackson.core</groupId><artifactId>jackson-databind</artifactId><version>2.12.3</version></dependency><dependency><groupId>jakarta.json</groupId><artifactId>jakarta.json-api</artifactId><version>2.0.1</version></dependency><!-- spring-data-elasticsearch 包含此包<dependency><groupId>org.elasticsearch.client</groupId><artifactId>elasticsearch-rest-high-level-client</artifactId><version>7.17.9</version></dependency>--><!-- Reactive Infrastructure --><dependency><groupId>org.springframework</groupId><artifactId>spring-webflux</artifactId></dependency><dependency><groupId>io.projectreactor.netty</groupId><artifactId>reactor-netty-http</artifactId></dependency>
es Spring Data Repositories
类似于spring data封装的ORM框架,也可以理解为MVC的M层,当然,完全可以灵活应用,也支持rest层
https://docs.spring.io/spring-data/elasticsearch/docs/4.4.10/reference/html/#repositories
例子:
//controller@PostMapping("/saveVisitLog")@ResponseBodypublic String saveVisitLog(@RequestBody VisitLog visitLog){VisitLog saveVisitLog = visitLogService.saveVisitLog(visitLog);log.info("----saveVisitLog----:{}", JSON.toJSONString(saveVisitLog));return JSON.toJSONString(saveVisitLog);}@GetMapping("/getVisitLogAll")@ResponseBodypublic String getVisitLogAll(){List<VisitLog> logList = visitLogService.findAll();log.info("----getVisitLogAll----:{}", JSON.toJSONString(logList));return JSON.toJSONString(logList);}//service@Overridepublic VisitLog saveVisitLog(VisitLog visitLog) {return visitLogRepository.save(visitLog);}@Overridepublic List<VisitLog> findAll() {Iterable<VisitLog> visitLogs = visitLogRepository.findAll();List<VisitLog> logs = new ArrayList<>();visitLogs.forEach(visitLog -> logs.add(visitLog));return logs;}//dao层@Repositorypublic interface VisitLogRepository extends ElasticsearchRepository<VisitLog, String> {}
ElasticsearchRepository分析
CrudRepository最终继承了这个对象,这个对象被按照规则封装实现了具体的操作
我们可以看下ElasticsearchRepository实现了哪些方法:
@NoRepositoryBean
public interface CrudRepository<T, ID> extends Repository<T, ID> {<S extends T> S save(S entity);<S extends T> Iterable<S> saveAll(Iterable<S> entities);Optional<T> findById(ID id);boolean existsById(ID id);Iterable<T> findAll();Iterable<T> findAllById(Iterable<ID> ids);long count();void deleteById(ID id);void delete(T entity);void deleteAllById(Iterable<? extends ID> ids);void deleteAll(Iterable<? extends T> entities);void deleteAll();
}
es Spring Data Repositories 关键字
spring data封装的ORM框架,很多接口继承的方法,也可以自定义方法,需要按照封装的规则自定义
https://docs.spring.io/spring-data/elasticsearch/docs/4.4.10/reference/html/#repositories.definition
例子:
//controller//自定义查询@GetMapping("/getVisitLogByUserLoginId")@ResponseBodypublic String getVisitLogByUserLoginId(Integer userLoginId){List<VisitLog> logList = visitLogService.findByUserLoginId(userLoginId);log.info("----getVisitLogAll----:{}", JSON.toJSONString(logList));return JSON.toJSONString(logList);}//service impl@Overridepublic List<VisitLog> findByUserLoginId(Integer userLoginId) {return visitLogRepository.findByUserLoginId(userLoginId);}//@Repositorypublic interface VisitLogRepository extends ElasticsearchRepository<VisitLog, String> {//自定义规则,By--关键字,UserLoginId字段,翻译下,就是查询-find 通过--By 字段--UserLoginId//spring data repository会去解析,同样的方式自行查reference文档List<VisitLog> findByUserLoginId(Integer userLoginId);}
es Spring Data Repositories client 加载
当然,一般使用封装好的也有一定的麻烦事情,也可以自己加载客户端,使用spring data repository 加载,两种方式,但是7.17的版本把这种方式去掉了,
https://docs.spring.io/spring-data/elasticsearch/docs/4.4.10/reference/html/#elasticsearch.clients
rest风格客户端
The Java High Level REST Clientis the default client of Elasticsearch,it is configured likes hown:
package org.lwd.microservice.boot.es.config;import org.elasticsearch.client.RestHighLevelClient;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.data.elasticsearch.client.ClientConfiguration;
import org.springframework.data.elasticsearch.client.RestClients;
import org.springframework.data.elasticsearch.config.AbstractElasticsearchConfiguration;/*** rest风格客户端* The Java High Level REST Client is the default client of Elasticsearch, it is configured like shown:** @author weidong* @version V1.0.0* @since 2023/7/27*/
@Configuration
public class EsRestHighLevelClientConfig extends AbstractElasticsearchConfiguration {@Value("${spring.elasticsearch.uris}")private String uris;@Override@Beanpublic RestHighLevelClient elasticsearchClient() {final ClientConfiguration clientConfiguration = ClientConfiguration.builder().connectedTo(uris).build();return RestClients.create(clientConfiguration).rest();}}
我们看下,那个bean可用(猜测一定被封装好了),AbstractElasticsearchConfiguration
public abstract class AbstractElasticsearchConfiguration extends ElasticsearchConfigurationSupport {/*** Return the {@link RestHighLevelClient} instance used to connect to the cluster. <br />** @return never {@literal null}.*/@Beanpublic abstract RestHighLevelClient elasticsearchClient();/*** Creates {@link ElasticsearchOperations}.** @return never {@literal null}.*/@Bean(name = { "elasticsearchOperations", "elasticsearchTemplate" })public ElasticsearchOperations elasticsearchOperations(ElasticsearchConverter elasticsearchConverter,RestHighLevelClient elasticsearchClient) {ElasticsearchRestTemplate template = new ElasticsearchRestTemplate(elasticsearchClient, elasticsearchConverter);template.setRefreshPolicy(refreshPolicy());return template;}
}
不知道各位发现没:@Bean(name = { “elasticsearchOperations”, “elasticsearchTemplate” })
用这个bean去操作
直接执行dsl例子
//rest模版操作@AutowiredElasticsearchOperations elasticsearchOperations;//rest客户端模版@GetMapping("/getHighTempt")@ResponseBodypublic String getHighTempt(){Query query = new StringQuery("{ \"match\": { \"userLoginId\": 1 } } ");query.setPageable(PageRequest.of(0, 10));SearchHits<VisitLog> searchHits = elasticsearchOperations.search(query,VisitLog.class);return JSON.toJSONString(searchHits);}
响应式客户端-ReactiveElasticsearchClient
- The ReactiveElasticsearchClient is a non official driver based on WebClient.
- It uses the request/response objects provided by the Elasticsearch core project.
- Calls are directly operated on the reactive stack, not wrapping async (thread pool bound) responses into reactive types.
如果不知道什么是响应式,自行百度
pom.xml
<!-- Reactive Infrastructure --><dependency><groupId>org.springframework</groupId><artifactId>spring-webflux</artifactId></dependency><dependency><groupId>io.projectreactor.netty</groupId><artifactId>reactor-netty-http</artifactId></dependency>
例子
package org.lwd.microservice.boot.es.config;import org.springframework.beans.factory.annotation.Value;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.data.elasticsearch.client.ClientConfiguration;
import org.springframework.data.elasticsearch.client.reactive.ReactiveElasticsearchClient;
import org.springframework.data.elasticsearch.client.reactive.ReactiveRestClients;
import org.springframework.data.elasticsearch.config.AbstractReactiveElasticsearchConfiguration;/*** 响应式客户端* The ReactiveElasticsearchClient is a non official driver based on WebClient.* It uses the request/response objects provided by the Elasticsearch core project.* Calls are directly operated on the reactive stack, not wrapping async (thread pool bound) responses into reactive types.** @author weidong* @version V1.0.0* @since 2023/7/28*/
@Configuration
public class EsReactiveRestClientConfig extends AbstractReactiveElasticsearchConfiguration {@Value("${spring.elasticsearch.uris}")private String uris;@Bean@Overridepublic ReactiveElasticsearchClient reactiveElasticsearchClient() {final ClientConfiguration clientConfiguration = ClientConfiguration.builder().connectedTo(uris) //.build();return ReactiveRestClients.create(clientConfiguration);}
}
//响应式模版操作@AutowiredReactiveElasticsearchOperations reactiveElasticsearchOperations;//响应式客户端@GetMapping("/getReactiveTemp")@ResponseBodypublic String getReactiveTemp(){Query query = new StringQuery("{ \"match\": { \"userLoginId\": 1 } } ");query.setPageable(PageRequest.of(0, 10));Flux<SearchHit<VisitLog>> result = reactiveElasticsearchOperations.search(query,VisitLog.class);return JSON.toJSONString(result);}
ES 原生方式加载客户端
从 ElasticSearch7.17 这个版本开始,原先的 Java 高级客户端
Java High Level REST Client 废弃了,不支持了。老实说,ElasticSearch 算是我用过的所有 Java 工具中,更新最为激进的一个了,在 Es7 中废弃了 TransportClient,7.17 又废弃了 TransportClient,那么现在用啥呢?现在的客户端叫做 Elasticsearch Java API Client。
Elasticsearch Java API Client 具有如下特性:
为所有 Elasticsearch APIs 提供强类型的请求和响应。
所有 API 都有阻塞和异步版本。
使用构建器模式,在创建复杂的嵌套结构时,可以编写简洁而可读的代码。
通过使用对象映射器(如 Jackson 或任何实现了 JSON-B 的解析器),实现应用程序类的无缝集成。
将协议处理委托给一个 http 客户端,如 Java Low Level REST Client,它负责所有传输级的问题。HTTP 连接池、重试、节点发现等等由它去完成。
关于第三点,松哥吐槽一句,确实简洁,但是可读性一般般吧。
另外还有两点需要注意:
Elasticsearch Java 客户端是向前兼容的,即该客户端支持与 Elasticsearch 的更大或相等的次要版本进行通信。
Elasticsearch Java 客户端只向后兼容默认的发行版本,并且没有做出保证。
pom.xml
<!--高版本单独使用elasticsearch client --><dependency><groupId>co.elastic.clients</groupId><artifactId>elasticsearch-java</artifactId><version>7.17.9</version></dependency><dependency><groupId>com.fasterxml.jackson.core</groupId><artifactId>jackson-databind</artifactId><version>2.12.3</version></dependency><dependency><groupId>jakarta.json</groupId><artifactId>jakarta.json-api</artifactId><version>2.0.1</version></dependency>
加载原生客户端
注意下,一定要用原生elasticsearch-java jar中的类
package org.lwd.microservice.boot.es.config;import co.elastic.clients.elasticsearch.ElasticsearchClient;
import co.elastic.clients.json.jackson.JacksonJsonpMapper;
import co.elastic.clients.transport.ElasticsearchTransport;
import co.elastic.clients.transport.rest_client.RestClientTransport;
import org.apache.http.HttpHost;
import org.elasticsearch.client.RestClient;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;/*** 使用elasticsearch client 7.17.9** @author weidong* @version V1.0.0* @since 2023/7/31*/
@Configuration
public class EsRestClientConfig {@Value("${spring.elasticsearch.uris}")private String uris;@Beanpublic ElasticsearchClient initSyncRestClient() {RestClient restClient = RestClient.builder(HttpHost.create(uris)).build();ElasticsearchTransport transport = new RestClientTransport(restClient, new JacksonJsonpMapper());ElasticsearchClient client = new ElasticsearchClient(transport);return client;}
}
controller使用
@AutowiredElasticsearchClient elasticsearchClient;//elasticsearch client 7.17.9@GetMapping("/getRestTemp")@ResponseBodypublic String getRestTemp(){StringReader sr = new StringReader("{\n" +" \"query\": { \"match\": {\n" +" \"userLoginId\": \"1\"\n" +" }}" +"}");//查询所有/* StringReader sr = new StringReader("{\n" +" \"query\": {\n" +" \"match_all\" : {}\n" +" }\n" +"}\n");*/SearchRequest request = new SearchRequest.Builder().index(Arrays.asList(new String[]{"visit_log"})).withJson(sr).build();try {SearchResponse<VisitLog> search = elasticsearchClient.search(request,VisitLog.class);System.out.println("search.toString() = " + search.toString());long took = search.took();System.out.println("took = " + took);boolean b = search.timedOut();System.out.println("b = " + b);ShardStatistics shards = search.shards();System.out.println("shards = " + shards);HitsMetadata<VisitLog> hits = search.hits();TotalHits total = hits.total();System.out.println("total = " + total);Double maxScore = hits.maxScore();System.out.println("maxScore = " + maxScore);List<Hit<VisitLog>> list = hits.hits();for (Hit<VisitLog> visitLogHit : list) {System.out.println("visitLogHit.source() = " + JSON.toJSONString(visitLogHit.source()));System.out.println("visitLogHit.score() = " + visitLogHit.score());System.out.println("visitLogHit.index() = " + visitLogHit.index());}} catch (IOException e) {e.printStackTrace();}return "";}
可以看到,直接把查询的 JSON 参数传进来也是可以的。这样我们就可以先在 Kibana 中写好脚本,然后直接将脚本拷贝到 Java 代码中来执行就行了。
验证结果
request [POST http://10.255.20.231:9200/visit_log/_search?typed_keys=true] returned 1 warnings: [299 Elasticsearch-7.17.9-ef48222227ee6b9e70e502f0f0daa52435ee634d "Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html to enable security."]
search.toString() = SearchResponse: {"took":0,"timed_out":false,"_shards":{"failed":0.0,"successful":1.0,"total":1.0,"skipped":0.0},"hits":{"total":{"relation":"eq","value":1},"hits":[{"_index":"visit_log","_id":"2","_score":0.9808291,"_type":"_doc","_source":"org.lwd.microservice.boot.es.entity.VisitLog@1bbbdce9"}],"max_score":0.9808291}}
took = 0
b = false
shards = ShardStatistics: {"failed":0.0,"successful":1.0,"total":1.0,"skipped":0.0}
total = TotalHits: {"relation":"eq","value":1}
maxScore = 0.9808291
visitLogHit.source() = {"_class":"org.lwd.microservice.boot.es.entity.VisitLog","createTime":"2023-07-27 16:34:36","id":2,"initialRequest":"http://localhost:8023","msgContent":"test es add2","serverHostName":"weidong","serverIpAddress":"127.0.0.1","tableName":"VisitLog","userLoginId":"1"}
visitLogHit.score() = 0.9808291
visitLogHit.index() = visit_log
测试请求http文件-TestEs.http
## 新增日志
POST http://localhost:8023/es/saveVisitLog
Content-Type: application/json{"id": 3,"tableName": "VisitLog","userLoginId": 3,"serverIpAddress": "127.0.0.1","serverHostName": "weidong","initialRequest": "http://localhost:8023","msgContent": "test es add3","createTime": "2023-07-27 16:34:36"
}### 获取所有数据-不分页GET http://localhost:8023/es/getVisitLogAll### 获取所有数据-自定义查询规则GET http://localhost:8023/es/getVisitLogByUserLoginId?userLoginId=1### 获取所有数据-high restGET http://localhost:8023/es/getHighTempt### 获取所有数据-reactive restGET http://localhost:8023/es/getReactiveTemp### 获取所有数据-elasticsearch client 7.17.9GET http://localhost:8023/es/getRestTemp
外传
😜 原创不易,如若本文能够帮助到您的同学
🎉 支持我:关注我+点赞👍+收藏⭐️
📝 留言:探讨问题,看到立马回复
💬 格言:己所不欲勿施于人 扬帆起航、游历人生、永不言弃!🔥