Gap between Professional Services reports and Engineering output in the platform
  Professional Services had reached the limitations of their existing toolset
  Tab and table syndrome - every new metric was being delivered to customers as either a new table on existing tabs, or as a new tab complete with more tables and graphs.
  Misaligned UX for graphs created in the BI tool vs. what had already been built.
The Outcome
  Integrated a BI tool into the web platform to close the gap between what PS was showing customers and what was in the platform. Leverage the available functionality.
  A delivery mechanism for custom and one off reports previously delivered as PDFs
  Allowing for new views across multiple projects in an insight focused unified interface
  Went from 5 tabs with countless tables to a 2 page template design that can house countless reports.
  Free up engineering capacity from playing front end keep-up to focusing on adding value through new backend processes and metrics
  PS requests became invasive to the product roadmap. Their ability to iterate quickly and put metrics in front of customers (hand-weeded using Excel) made us beholden to deliver that feature in product.
•  By the time it was released, customers were interested in the next big thing.
Additional Benefits
   Cross-repository analytics — adding new functionality in fewer screens and a unified experience
   The ability to deliver custom & one-off reporting to customers
   Custom dashboards (co-designed with client and professional services)
   Interval reporting ("Sema Code Quality Health Check" & "Sema Technical Due Diligence")
About Sema
Sema Software is bringing transparency to software development with new and established metrics for people, process and code. Serving organizations and fortune 500 companies, they offer professional services — individualized regular reporting, technical due diligence reports and recommendations catered to the client, paired with a web platform.
Phase 1
Adding the first report. In order to test the functionality of a BI tool integration we added a single tab which took users to the Reports page. This page was a single page white-label embedded of a Mode Analytics report. Each user saw the same report, showing data from within their organization. This feature launched with a single report drawn from a new data lake which was populated by data synced from Sema's database, as well as a script generated .CSV that Professional Services generated.
White-label embed reports section using built-in filters, styled with CSS
Over the next few months, the report continued to grow — numerous graphs and queries, a sidebar for report navigation, and tooltips to guide users — all with minimal engineering resources. The page was extended in collaboration between professional services (who were now preparing custom reports in the same BI tool) and the product & design team (just me) were creating and styling the report using the theming and html/css editor of the BI tool. The embedded reports and data lake proved a big win as engineering resources were limited and precious. It became the most visited page, had the highest engagement, and user feedback was clear — more of this.
Phase 2
Engineering, Product and Professional Services all agreed on the success of this integration, but we began to notice a few issues;
  Slow loading - with so many queries in on report, load times were suffering
  Long scrolling page was hard to for users to navigate. On our end the CSS navigation required some finesse each time new reports were added
  The filter panel that came out of the box with the BI tool was becoming convoluted, and it was a challenge to maintain interactivity across the many graphs
    ie. not all data could be filtered to a date range, but we lacked the ability to indicate where fitlers were and were not applied
  Inconsistent filtering experiences in the reports vs existing functionality
  Discrepancies in data — usually caused by one of 2 issues
    Replicating calculations in SQL which didn't always match the scripts or backend processes customers
    A time delay between the live database powering the core platform and the delayed sync to the data lake feeding reports.
  Can't save filters, share report views, or deliver custom reports to individual users or organizations — future functionality we know users expected.
Because of the positive traction of technical due diligence and health checks, our engineering team was working to generate all metrics required for reports in the database - making these a pushbutton effort for analysts, and eliminating the use of scripts and CSVs. We couldn't add all these reports to a single page while being performant and improving user experience.
An opportunity to simplify
From a product and design outlook, we could see a never ending game of catch up (adding report metrics to core platform each time a new report or metric was generated) and more fragmentation between what users saw from analysts and in reports. The current UI just wasn't suited to adapt to the numerous new reports, nor the other major functionality to follow.
This is where lightning struck — a chance to clear house, simplifying the product experience, reducing maintenance and maximizing the use of the integrated BI tool.
We had a chance to replace all the current navigation pages (3 top level, 5 sub-pages + project selector) with 3 functional components;
  Reports section — a page where all available reports are listed
  Report template — the page where an individual report is embedded
  Filters — modular dropdown selector inputs contextual to the current report
This was a sort of elegant solution providing an improved interaction with existing functionality and a clean slate for broad product updates beyond reporting. By tightening the integration with the BI tool, we would see some tremendous benefits with less engineering effort.
  The new filter UI would allow us to;
  •  collect usage analytics
  •  save and share filtered views
  •  use the PDF output functionality of the BI tool for one-time or scheduled frequency
give us control over grouping functionality (repositories → projects, people → teams)
  Deliver interactive ad-hoc reports, Health Checks and Due Diligence to customers through the web app. An improvement over reports compiled in Word and delivered as a PDF. This delivery could happen without involving engineering and outside of the release cycle.
  Cross-project views and comparison that wasn't available in the core product
  All graphing and tables would come from the BI tool, which allows us to delete a significant amount of legacy

More Stuff

Back to Top