Test-COMP

Intl. Software Testing Competitions (Test-Comp)

Test-Comp 2024

• Competing Version: FuSeBMC 4.2.1 / ESBMC 6.4
• Division Entered:
  • Cover-Error: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Fuzzle, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-ProductLines, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, ReachSafety-Hardware, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-OpenBSD-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety
  • Cover-Branches: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Fuzzle, ReachSafety-Hardness, ReachSafety-Hardware, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-ProductLines, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, ReachSafety-Combinations, SoftwareSystems-AWS-C-Common-ReachSafety, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-OpenBSD-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety, SoftwareSystems-SQLite-MemorySafety, Termination-BitVectors, Termination-MainControlFlow, Termination-MainHeap.
• Awards:
  • 1^st Place in Cover-Error
  • 1^st Place in Cover-Branches
  • 1^st Place in Overall

Test-Comp 2023

• Competing Version: FuSeBMC 4.2.1 / ESBMC 6.4
• Division Entered:
  • Cover-Error: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-ProductLines, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, ReachSafety-Hardware, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety
  • Cover-Branches: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-ProductLines, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, ReachSafety-Combinations, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety, SoftwareSystems-SQLite-MemorySafety, Termination-MainHeap.
• Awards:
  • 1^st Place in Cover-Error
  • 1^st Place in Cover-Branches
  • 1^st Place in Overall

Test-Comp 2022

• Competing Version: FuSeBMC 4.1.14 / ESBMC 6.4
• Division Entered:
  • Cover-Error: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-ProductLines, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety
  • Cover-Branches: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-ProductLines, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, ReachSafety-Combinations, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety, SoftwareSystems-SQLite-MemorySafety, Termination-MainHeap.
• Awards:
  • 1^st Place in Cover-Error
  • 1^st Place in Cover-Branches
  • 1^nd Place in Overall

Test-Comp 2021

• Competing Version: FuSeBMC 3.6.6 / ESBMC 6.4
• Division Entered:
  • Cover-Error: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety
  • Cover-Branches: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-Recursive, ReachSafety-Sequentialized, ReachSafety-XCSP, ReachSafety-Combinations, SoftwareSystems-BusyBox-MemSafety, SoftwareSystems-DeviceDriversLinux64-ReachSafety, SoftwareSystems-SQLite-MemorySafety, Termination-MainHeap.
• Awards:
  • 1^st Place in Cover-Error
  • 2^nd Place in Overall

Test-Comp 2020

• Competing Version: ESBMC 6.1
• Division Entered:
  • Cover-Error: ReachSafety-Arrays, ReachSafety-BitVectors, ReachSafety-ControlFlow, ReachSafety-ECA, ReachSafety-Floats, ReachSafety-Heap, ReachSafety-Loops, ReachSafety-Recursive, ReachSafety-Sequentialized.
• Award:
  • 3^rd Place in Bug Finding