MedFuzz: Exploring the robustness of LLMs on medical challenge problems
September 10, 2024 | Robert Osazuwa Ness
Medfuzz tests LLMs by breaking benchmark assumptions, exposing vulnerabilities to bolster real-world accuracy.
Microsoft Research Blog
MedFuzz: Exploring the robustness of LLMs on medical challenge problems
September 10, 2024 | Robert Osazuwa Ness
Medfuzz tests LLMs by breaking benchmark assumptions, exposing vulnerabilities to bolster real-world accuracy.
Recent Posts
-
-
GraphRAG auto-tuning provides rapid adaptation to new domains
September 9, 2024GraphRAG uses LLM-generated knowledge graphs to substantially improve complex Q&A over retrieval-augmented generation (RAG). Discover automatic tuning of GraphRAG for new datasets, making it more accurate and relevant.
-
Innovations in AI: Brain-inspired design for more capable and sustainable technology
Researchers and their collaborators are drawing inspiration from the brain to develop more sustainable AI models. Projects like CircuitNet and CPG-PE improve performance and energy efficiency by mimicking the brain's neural patterns.
-
Research Focus: Week of August 26, 2024
August 28, 2024Learn what’s next for AI at Research Forum on Sept. 3; WizardArena simulates human-annotated chatbot games; MInference speeds pre-filling for long-context LLMs via dynamic sparse attention; Reef: Fast succinct non-interactive zero-knowledge regex proofs.
-
Research Focus: Week of August 12, 2024
August 14, 2024In this issue: Research Forum Ep. 4 explores multimodal AI. Registration is now open; Surveying developers’ AI needs; SuperBench improves cloud AI infrastructure reliability; Virtual Voices: Exploring factors influencing participation in virtual meetings.
-
Large-scale pathology foundation models show promise on a variety of cancer-related tasks
August 8, 2024 | Kristen Severson and Philip RosenfieldMicrosoft researchers collaborated to release new pathology foundation models. Their report shows models benefit from diverse data, increased model size, and specialized algorithms to enhance the accuracy and applicability of cancer diagnosis and treatment.
-
GENEVA uses large language models for interactive game narrative design
August 5, 2024 | Sudha Rao, Chris Brockett, and Bill DolanDesigned for interactive storytelling in games, GENEVA lets users explore narrative paths and adapt stories to diverse contexts. It uses LLMs to generate and visualize branching narratives from high-level descriptions, representing them as graphs.
-
Players, creators, and AI collaborate to build and expand rich game narratives
August 5, 2024 | Sudha Rao, Chris Brockett, and Bill DolanIntegrating LLMs in video game development can create dynamic and interactive narratives. By involving players in the narrative design process, LLMs can generate unique player-driven strategies and provide valuable feedback for game designers.
-
Research Focus: Week of July 29, 2024
July 31, 2024In this issue: Skeleton Posterior-guided OpTimization (SPOT) exhibits potential in various causal discovery tasks; Using visual imagery for an EEG-based brain–computer interface; Developing human-centered AI systems to assist creative professionals.
-
Tracing the path to self-adapting AI agents
July 25, 2024 | Ching-An Cheng, Adith Swaminathan, and Allen NieIntroducing Trace, Microsoft and Stanford University's novel AI optimization framework, now available as a Python library. Trace adapts dynamically and optimizes a wide range of applications from language models to robot control.
-
Microsoft at ICML 2024: Innovations in machine learning
July 22, 2024The competitive dynamics of AI agents and a method for learning and applying temporal action abstractions represent just some of Microsoft’s contributions to ICML 2024.
-
Research Focus: Week of July 15, 2024
July 17, 2024Advancing time series analysis with multi-granularity guided diffusion model; An algorithm-system co-design for fast, scalable MoE inference; What makes a search metric successful in large-scale settings; learning to solve PDEs without simulated data.
Explore More
-
Events & conferences
Meet our community of researchers, learn about exciting research topics, and grow your network
-
Podcasts
Ongoing conversations at the cutting edge of research
-
Microsoft Research Forum
Join us for a continuous exchange of ideas about research in the era of general AI