基于alibaba druid的血缘解析
1、前言
仅仅对mysql数据库的select查询语句进行了血缘解析,该血缘解析包含了原始表字段、临时表字段和目标表字段的关联关系。
2、涉及到技术
主要使用了druid的如下接口对语法树进行解析:
(1)selement
- SQLSelectStatement
(2)sqlselectquery
- SQLUnionQuery
- SQLSelectQueryBlock
- MySqlSelectQueryBlock
(3)tablesource
- SQLExprTableSource
- SQLJoinTableSource
- SQLSubqueryTableSource
- SQLUnionQueryTableSource
(4)sqlexpr
- SQLAggregateExpr
- SQLAllColumnExpr
- SQLIdentifierExpr
- SQLPropertyExpr
- SQLQueryExpr
3、成果展示
主要和datablau血缘解析工具进行对比
(1)select语句中包含关联查询和字段中包含子查询
SELECTe.employee_id,e.name,e.gender,e.date_of_birth,e.date_of_hire,d.department_name,ts.total_salary,b.bonus,(SELECTB.id,B.CGFS,B.WLZ,B.CPMC,B.CGSL,B.ZXCJ,B.ZXJE,B.HTGLXTHTH,B.CGPZH,B.WZBM,B.HSZJ,B.BEDNR JHBH,B.WCXTCGDDID,B.ZHTDAT,D.WERKS_NAME XQGCMC,D.WERKS XQGCBMFROM(SELECTA.id,A.ZCGFS CGFS,A.MATKL WLZ,A.TXZ01 CPMC,A.MENGE CGSL,A.NAME1 ZXCJ,A.ZHSDJ ZXJE,A.ZHTNUM HTGLXTHTH,A.EBELN CGPZH,A.MATNR WZBM,A.ZHSZJ HSZJ,A.ZHTDAT,C.EMATN,C.BEDNR,C.ZCGDDID WCXTCGDDIDFROMTB_ERP_ZP11MMRP008 A,TB_ERP_ME2M CWHEREA.EBELN = C.EBELNand A.MATNR = C.EMATN) B,TB_ERP_ZP10MMDG030 DWHEREB.BEDNR = D.BEDNRAND B.EMATN = D.MATNRand B.ZHTDAT > to_date('2023/05/01 00:00:00', 'YYYY/MM/DD HH24:MI:SS')) as sfs,(selects.dfromstudent swherestudent_id = e.employee_id) as saf12
FROMemployee eINNER JOIN department d ON e.department_id = d.department_idINNER JOIN tmp_salary ts ON e.employee_id = ts.employee_idLEFT OUTER JOIN bonus b ON e.employee_id = b.employee_id;
本血缘解析工具分析结果:
-- TB_ERP_ZP11MMRP008.NAME1 -> B.ZXCJ -> SELECT_STATEMENT_2.ZXCJ -> SELECT_STATEMENT_0.sfs
-- employee.date_of_birth -> SELECT_STATEMENT_0.date_of_birth
-- TB_ERP_ZP11MMRP008.ZHTDAT -> B.ZHTDAT -> SELECT_STATEMENT_2.ZHTDAT -> SELECT_STATEMENT_0.sfs
-- department.department_name -> SELECT_STATEMENT_0.department_name
-- bonus.bonus -> SELECT_STATEMENT_0.bonus
-- student.d -> SELECT_STATEMENT_5.d -> SELECT_STATEMENT_0.saf12
-- TB_ERP_ZP11MMRP008.MATNR -> B.WZBM -> SELECT_STATEMENT_2.WZBM -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP11MMRP008.EBELN -> B.CGPZH -> SELECT_STATEMENT_2.CGPZH -> SELECT_STATEMENT_0.sfs
-- employee.name -> SELECT_STATEMENT_0.name
-- TB_ERP_ZP11MMRP008.ZHTNUM -> B.HTGLXTHTH -> SELECT_STATEMENT_2.HTGLXTHTH -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP11MMRP008.MATKL -> B.WLZ -> SELECT_STATEMENT_2.WLZ -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP10MMDG030.WERKS -> SELECT_STATEMENT_2.XQGCBM -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP11MMRP008.ZCGFS -> B.CGFS -> SELECT_STATEMENT_2.CGFS -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP11MMRP008.MENGE -> B.CGSL -> SELECT_STATEMENT_2.CGSL -> SELECT_STATEMENT_0.sfs
-- employee.gender -> SELECT_STATEMENT_0.gender
-- TB_ERP_ZP11MMRP008.TXZ01 -> B.CPMC -> SELECT_STATEMENT_2.CPMC -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP11MMRP008.id -> B.id -> SELECT_STATEMENT_2.id -> SELECT_STATEMENT_0.sfs
-- tmp_salary.total_salary -> SELECT_STATEMENT_0.total_salary
-- TB_ERP_ZP11MMRP008.ZHSZJ -> B.HSZJ -> SELECT_STATEMENT_2.HSZJ -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ME2M.ZCGDDID -> B.WCXTCGDDID -> SELECT_STATEMENT_2.WCXTCGDDID -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ZP11MMRP008.ZHSDJ -> B.ZXJE -> SELECT_STATEMENT_2.ZXJE -> SELECT_STATEMENT_0.sfs
-- TB_ERP_ME2M.EMATN -> B.EMATN
-- TB_ERP_ME2M.BEDNR -> B.BEDNR -> SELECT_STATEMENT_2.JHBH -> SELECT_STATEMENT_0.sfs
-- employee.date_of_hire -> SELECT_STATEMENT_0.date_of_hire
-- employee.employee_id -> SELECT_STATEMENT_0.employee_id
-- TB_ERP_ZP10MMDG030.WERKS_NAME -> SELECT_STATEMENT_2.XQGCMC -> SELECT_STATEMENT_0.sfs
datablua血缘解析工具结果:
(2)select联合查询
select s.id from student s union select e.id from employees e
本血缘解析工具分析结果:
-- student.id -> SELECT_STATEMENT_0.id
-- employees.id -> SELECT_STATEMENT_1.id
datablua血缘解析工具结果:
4 待优化点
- 不支持没有别名的select查询
- 联合查询没有结果汇总,有待优化