Contribution & Conclusion
- A new framework to combine LLM and Graph data.
- Ten common scenarios to assess the LLMs’ graph understanding ability.
- Still a long way to go to make LLMs understanding graph data better. The core challenge lays in the intrinsic differences between sequence data and graph data.
Benchmarks (10 scenarios)
结构理解:
size detection;
degree;
neighbor;
attr;
diameter;
cluster coefficient ;
data: citation-net’s 100 sampled small subgraphs;
语义理解: