datatester of vedi, a subsidiary of volcano engine, has evolved again, and a/b large model application evaluation is launched online
2024-09-12
한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina
recently, datatester, the a/b testing product of volcano engine, launched the a/b large model application evaluation function. this upgrade not only strengthens the basic capability evaluation before the model goes online, but also adds a comprehensive and systematic detection and evaluation mechanism for online usage scenarios, providing strong support for enterprises in the full-cycle management of model applications.
datatester's a/b large model application evaluation function covers a variety of target landing scenarios such as chatbot, agent (multi-capable intelligent body), rag and summarization (intelligent summary). through built-in rich analysis indicators, this function can automatically generate model online reports, simplify the a/b experiment process, and promote the efficient release of strategies. its features include model evaluation and indicator optimization, comparative experiment selection of models and prompts, real-time alarms and full-line business detection, as well as strategy backtesting and effect analysis and other complete monitoring links to ensure that the model can be scientifically and effectively managed and optimized at every stage after going online.
this upgrade also highlights datatester's "out-of-the-box" intelligent decision-making features, lowering the usage threshold for business-end users and enabling a smoother integration of data flows and business flows. as a core product of vedi, the digital intelligence platform of volcano engine, datatester has been recognized by the market for its experimental management capabilities and scenario-based special experimental capabilities. relying on bytedance's long-term technological accumulation and advanced algorithms, datatester now supports more than 500 businesses within bytedance, and has successfully served hundreds of external companies such as midea, huatai securities, bsh home appliances, and leke fitness, continuously driving business growth with one-stop experimental management solutions.
while continuously improving the service capabilities of its product platform, vedi is also actively expanding the application scenarios of enterprise data. in addition to the a/b experimental capabilities provided by datatester, vedi has also launched a series of data tools such as datawind for data insight analysis, datafinder for growth analysis, vecdp and gmp for enterprise precision marketing, aiming to cover the full-link digital intelligence capabilities required by enterprises, help enterprises realize full-scenario data consumption, and fully release the value of data.
at present, volcano engine digital intelligence platform has carried out in-depth cooperation with many well-known companies in multiple industries such as finance, mass consumption, pan-internet, and automobiles to jointly explore new models of business growth driven by data consumption. in the era of big models, volcano engine digital intelligence platform vedi will continue to uphold the core concept of "data-driven business, ai-enabled products" to provide continuous power and support for the digital transformation of enterprises.
