Monitly.AI Launches Enhanced Generative AI Evaluation Platform with Government Support

Monitly.AI Revolutionizes Generative AI Operations with Major Update

As the adoption of generative AI accelerates, many companies still face challenges in establishing effective operational and quality evaluation systems. Monitly.AI Corporation, based in Shinagawa, Tokyo, has developed and provided an innovative platform named Monitly.AI to tackle these issues. Recently, the company was selected for the Ministry of Economy, Trade and Industry's "19th Manufacturing Subsidy," enabling them to implement significant updates aimed at enhancing user experience and team operations.

Background of the Subsidy Adoption

Monitly.AI serves as an all-in-one platform designed to continuously assess and improve the output quality of generative AI, including RAG (Retrieval-Augmented Generation) and agents. As companies transition from the proof of concept (PoC) stage to full-scale operations, they often encounter challenges such as "invisible risks to quality," "person-dependent improvement processes," and "inefficient evaluations." Monitly.AI addresses these challenges, positioning itself as a foundational tool for quality operations in generative AI.

This initiative has been recognized for its potential to enhance productivity and quality in the implementation of generative AI within Japanese companies, leading to its recent selection for the subsidy.

Key Product Updates Overview

1. Comprehensive UI Overhaul

The platform has undergone a complete redesign to enhance its responsiveness, enabling intuitive navigation for users without deep AI expertise. This revamped UI/UX is tailored for project managers, operational staff, and executives who may not be engineers yet need to engage with generative AI evaluation and operations.

(Image references: New UI dashboard, comparison screen, review management)

2. Strengthened Review and Approval Workflow

With centralized review requests, approvals, and progress management based on teams and projects, the new functionalities allow for milestone setting and visualization of task progress. This creates a transparent record of who approved what and when, bolstering internal controls in the quality management of generative AI.

(Image reference: Review and approval management screen)

3. Enhanced Operational Dashboard and Monitoring Features

A new dashboard offers real-time visibility into quality, costs, and response times during operations. It also supports anomaly detection, alert notifications, and historical metrics analysis, enabling continuous monitoring. This provides immediate awareness of accuracy declines and cost overruns related to AI agents and RAG configurations.

(Image reference: Operational dashboard)

Future Outlook: Strengthening Local LLM Integration

Recently, there has been a growing demand for local LLM solutions such as Ollama and LM Studio, which handle enterprise data securely. Monitly.AI plans to enhance its integration capabilities with these local LLMs, creating a flexible environment for deployment, whether in the cloud or on-premises.
"Our mission is to support Japanese companies in generative AI operations from the perspective of quality and sustainability," asserts Monitly.AI's leadership.

About Monitly.AI

Monitly.AI is a Japan-based SaaS platform specializing in the evaluation, improvement, and operational management of generative AI, including RAG and AI agents. It integrates various functionalities such as model comparison, log management, SME evaluation, operational monitoring, improvement history visualization, and team collaboration, systematically replacing subjective evaluation processes. As the only evaluation platform localized for Japanese companies, it supports the journey from PoC to full-scale implementation.

Company Overview

- Company Name: Monitly.AI Corporation
- CEO: Tomoyuki Hioki
- Address: 1-1-1 Nishishinagawa, Shinagawa, Tokyo, Japan 141-0033, Sumitomo Realty Ohsaki Garden Tower, 9th Floor
- Established: April 2025
- Business Area: Planning, development, and provision of generative AI operational evaluation SaaS "Monitly.AI"
- Website: monitly.ai