TY - CONF A1 - Demir, Nurullah A1 - Hörnemann, Jan A1 - Große-Kampmann, Matteo A1 - Urban, Tobias A1 - Pohlmann, Norbert A1 - Holz, Thorsten A1 - Wressnegger, Christian T1 - On the Similarity of Web Measurements Under Different Experimental Setups T2 - Proceedings of the 23nd ACM Internet Measurement Conference (IMC '23) N2 - Measurement studies are essential for research and industry alike to understand the Web’s inner workings better and help quantify specific phenomena. Performing such stud� ies is demanding due to the dynamic nature and size of the Web. An experiment’s careful design and setup are complex, and many factors might affect the results. However, while several works have independently observed differences in the outcome of an experiment (e.g., the number of observed trackers) based on the measurement setup, it is unclear what causes such deviations. This work investigates the reasons for these differences by visiting 1.7M webpages with five different measurement setups. Based on this, we build ‘de� pendency trees’ for each page and cross-compare the nodes in the trees. The results show that the measured trees differ considerably, that the cause of differences can be attributed to specific nodes, and that even identical measurement setups can produce different results. Y1 - 2023 UR - https://whge.opus.hbz-nrw.de/frontdoor/index/index/docId/4383 UR - https://norbert-pohlmann.com/wp-content/uploads/2023/10/453-On-the-Similarity-of-Web-Measurements-Under-Different-Experimental-Setups-Prof-Norbert-Pohlmann.pdf VL - 2023 SP - 356 EP - 369 ER -