Executive Summary
The Open Data Examination and Verification (E&V) authorizes MODA to critically examine three specific City agencies’ data inventories while reflecting on ways to improve the City of New York’s Open Data program at large. After three years of E&V, it is clear that open data is becoming a routine part of many agencies’ data operations. As they move beyond immediate compliance with the Open Data Law, agencies are seeking more sustainable models for staffing open data capabilities while improving the quality and reliability of their data releases.
All agencies not only compiled, but were open and cooperative. The Department of Transportation (DOT), Department of Small Business Services (SBS), and Business Integrity Commission (BIC) fully complied with the requirements established in MODA’s E&V plan. Each agency was responsive, timely, and thorough in completing the process.
The process gave agencies more clarity on whether they were in compliance with the Open Data Law. E&V is an organizational learning process for agencies involved. Regular check-ins with MODA and a structured approach to evaluating lines of business across the agency in search of data gave agencies confidence that they are currently in full compliance.
The E&V process is effective but requires significant effort. Each agency identified new datasets to publish, but all dedicated significant staff resources to data discovery.
The Open Data team should develop guidance and provide oversight on publishing multi-agency data products.
The Open Data team should explore agency requirements and potential technology solutions to reduce the time it takes agencies to collect information for mandatory reporting and manage their inventories on the Open Data Portal.
Business and data analysts should be part of Open Data processes at agencies. Data analysts can help ensure that data published in a useful and usable way.
