star
right
productproduct
star
product
product
productproduct
right
Large Language Model Compression
Improving Word Embedding Models
Large Language Model Compression
In this work, we tackle the critical challenge of compressing large language models (LLMs) to facilitate their practical deployment and broader adoption. We introduce a novel post-training compression paradigm that focuses on the low-rank decomposition of LLM weights. Our analysis identifies two main challenges in this task: the variability in LLM activation distributions and handling unseen activations from different datasets and models.
Large Language Model Compression
In this work, we tackle the critical challenge of compressing large language models (LLMs) to facilitate their practical deployment and broader adoption. We introduce a novel post-training compression paradigm that focuses on the low-rank decomposition of LLM weights. Our analysis identifies two main challenges in this task: the variability in LLM activation distributions and handling unseen activations from different datasets and models.
right
Milestone in R&D Excellence – Byte Ark Achieves CMMI Certification
May 22-24, 2024
Milestone in R&D Excellence – Byte Ark Achieves CMMI Certification
After four months of dedicated teamwork and effort, Hangzhou Byte Ark Technology Co., Ltd. has successfully passed the CMMI (Capability Maturity Model Integration) assessment and obtained its official certification. This achievement not only showcases the company’s technical strength but also marks a significant milestone, demonstrating that Byte Ark’s R&D management capabilities in AI infrastructure have reached an internationally recognized level.
HangZhou ZIJIEFANGZHOU Technology Co., Ltd. Achieves Dual ISO20000 & ISO27001 Certifications
May 22-24, 2024
HangZhou ZIJIEFANGZHOU Technology Co., Ltd. Achieves Dual ISO20000 & ISO27001 Certifications
In June of this year, Hangzhou Byte Ark Technology Co., Ltd. successfully obtained the ISO20000 Information Technology Service Management System Certification and ISO27001 Information Security Management System Certification. This achievement not only highlights the company’s excellence in IT service management and information security but also reflects Byte Ark’s customer-centric business philosophy.
ByteArk Invited to AI EXPO JAPAN 2024 in Tokyo
May 22-24, 2024
ByteArk Invited to AI EXPO JAPAN 2024 in Tokyo
From May 22 to 24, 2024, the 2024 Zhejiang Service Trade (Japan) Artificial Intelligence Exhibition, hosted by the Department of Commerce of Zhejiang Province, was successfully held at the Tokyo Big Sight International Exhibition Center. As a leading representative of Zhejiang’s AI industry, Hangzhou Byte Ark Technology Co., Ltd. showcased its cutting-edge AI infrastructure management platform and technology services at the event.
Byte Ark Showcases Latest AI Infrastructure Solutions at Singapore Tech Week 2024
May 22-24, 2024
Byte Ark Showcases Latest AI Infrastructure Solutions at Singapore Tech Week 2024
From October 9 to 10, the Singapore Artificial Intelligence & Big Data Expo was grandly held at Marina Bay Sands, Singapore. Byte Ark Technology was invited to participate and showcased its latest AI infrastructure solutions at the 2024 Singapore Data Centre World Asia exhibition.

Bill
Sphinx