Skip to content
#edge computing Open access

An Intelligent Entity Resolution at Scale: A Graph-Based Social Network Framework

Oct 2026 · International journal of advances in soft computing and its applications · 0 citations
Data Quality and Management

Abstract

Entity Resolution (ER) seeks to identify and merge, within one or more datasets, whichever records ultimately correspond to the same real-world entity. As one of the tasks most consequential for data quality and for the reliability of downstream analysis, ER becomes markedly harder under Big Data conditions, given the sharp rise in both the volume of data and the speed of its arrival. This work approaches ER by recasting it as a problem set within a Social Network space, so that Social Network Analysis (SNA) measures and tools can be brought to bear on it directly. A six-phase framework is proposed that represents entity records as nodes and edges of a graph and applies centrality measures to reveal redundancy among them. Four established models were evaluated against datasets of three different sizes (500, 10,000, and 2,000,000 records): k-means, Levenshtein distance, Jaro-Winkler distance, and Soundex. Levenshtein and Soundex achieved the highest measured precision (100%), while Jaro-Winkler followed closely (99.99%) and k-means trailed substantially (91.33%) despite running fastest; precision was computed as TP/(TP+FP) against RLdata10000's known duplicate structure. Because true matches make up under 0.1% of all record pairs in this dataset, these figures behave closer to a non-match specificity score than to a conventional precision measure computed over predicted matches alone, and should be interpreted with this caveat in mind. The findings indicate that the ER problem can be resolved effectively from within an SNA setting, with the Levenshtein algorithm providing the strongest balance of speed against accuracy for the proposed SNA-driven framework.

Read PDF

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Oct 29, 2026

Microsoft Research Focus – Edition #97

Host Sowbhagya Suresh shares some of the latest news and cutting-edge research from across Microsoft—from understanding the challenges facing coding agents to uncovering how people use AI at work and improving extended-range weather forecasting. The post Microsoft Research Focus – Edition #97 appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.