Key Aspects of the Study:
The study presents CRMAgent, a system made of several specialized LLM agents (analyst, copywriter, evaluator) that automatically improves marketing messages. The system analyzes successful and unsuccessful text examples, extracts "recipes for success" from them, and then rewrites weak messages using those recipes. The result is text that is noticeably more persuasive and better suited to the target audience.
Key Result: A systematic approach built on analyzing examples and splitting roles lets an LLM consistently generate text that beats the original human-written versions on quality.
The Core of the Method, Explained:
For practical use, the core of the method is to stop giving the LLM simple commands like "rewrite this text" and instead walk the model through a structured process that imitates a team of experts at work. You can implement this process in a single prompt by splitting it into logical blocks.
The "Internal Expert Council" technique:
Assigning roles (Decomposition): You don't just ask the LLM to do something. You give it a sequence of roles. First the Analyst/Strategist, then the Creator/Copywriter and, optionally, the Critic/Evaluator.
Learning from examples (Few-Shot with analysis): Instead of just supplying examples, you make the "Analyst" study them. You give it both good and bad text samples for your task. Its job isn't just to see them but to formulate principles: why the good examples work and the bad ones don't.
Generating from principles: The "Copywriter" gets the task of writing or reworking the text. The key difference is that it has to strictly follow the principles the "Analyst" just formulated. That grounds the creative process and points it in the right direction.
Self-verification: At the end you can ask the LLM, as the "Critic," to grade the generated text (and maybe compare it with the original) against clear criteria you set (for example, "Persuasiveness," "Tone fit," "Clarity of the call to action").
This approach turns the LLM from a simple executor into a partner that first figures out what the task is really about and then solves it.
Practical Applicability Analysis:
Direct applicability: Very high. A user can copy the prompt structure from the study (Figures 2, 3, 4) and adapt it to any text-generation task: social media posts, email newsletters, resumes, project specs. You just swap the CRM examples for your own.
Conceptual value: Huge. The study teaches a fundamental principle of prompt engineering: decomposition and grounding. Instead of one complex request, you create a sequence of simple, logically linked steps. It helps users understand that to get a quality result, you first need to "explain" to the model what you consider quality by giving it material to analyze.
Adaptation potential: Maximal. The adaptation mechanism is simple:
- Define your task (for example, "write a product description for an Amazon listing").
- Find 2-3 examples of excellent descriptions and 2-3 examples of bad ones.
- Build the prompt using the "Internal Expert Council" technique: ask the LLM to first analyze your examples and derive the "golden rules" of a good description, then write the description for your product based on those rules.
A Practical Example:
You are an experienced social media strategist and copywriter who specializes in audience engagement on Instagram.
Your task is to analyze example posts and, based on them, rewrite a boring webinar announcement so it's engaging and motivates people to sign up.
**STEP 1: ANALYZE THE EXAMPLES**
Analyze the successful and unsuccessful announcement examples below. Formulate 3-4 key principles that make an announcement successful.
=== Successful examples (High-Performing) ===
1. "Tired of task chaos? 🤯 On May 15 at 7 pm I'll show you 3 non-obvious Notion tricks that saved me 10 hours a week. This isn't just theory, it's my personal experience! Only 100 spots. Sign-up link in bio!"
2. "Want to draw but think you have 'no talent'? I'll prove you wrong! Join my free webinar 'Your First Sketch in 60 Minutes.' Step by step, together, we'll create an awesome illustration. Even if you've never held a pencil. When? This Saturday. Sign up via the link to get a materials guide!"
=== Unsuccessful examples (Low-Performing) ===
1. "Everyone is invited to a webinar on time management. The speaker will talk about planning techniques. Date: May 15."
2. "An online event on 'Drawing for Beginners' will take place. Key aspects will be covered. Don't miss it."
**Your analysis and conclusions (principles of success):**
---
**STEP 2: REWRITE THE ANNOUNCEMENT**
Now, using the principles you derived, rewrite the following boring announcement. Keep the key information (topic, date, speaker), but make the text lively, persuasive and give it a clear call to action.
**=== Announcement to improve ===**
"A webinar on 'Financial Literacy' is coming up soon. The speaker is Emma Miller. She will talk about how to manage a budget. Date: May 25."
**Your new, improved announcement:**
Why It Works:
This prompt is effective because it doesn't just ask to "make it pretty"; it makes the LLM go through a professional copywriter's thought process:
- Contextual learning (Few-Shot Learning): The model sees concrete examples of what "good" and "bad" look like specifically for announcements. That's far more effective than abstract instructions.
- Extracting principles (Rule Induction): The command "formulate the key principles" makes the model reflect on what it saw and write itself an internal "instruction." It might derive something like: "1. Open with the audience's pain. 2. Make a concrete promise of results. 3. Add urgency or scarcity. 4. Give a clear call to action."
- Grounded generation: In the second step the model doesn't generate text out of thin air; it relies on the instruction it just created. That makes the result predictable, relevant and high-quality.
Another Practical Example
You are an HR expert and career coach who helps candidates write strong cover letters.
Your task is to analyze example cover letters and, based on them, rewrite a weak letter so it's persuasive to a recruiter.
**STEP 1: ANALYZE THE EXAMPLES**
Analyze the successful and unsuccessful letter excerpts below. Formulate 3-4 key principles that make a cover letter effective.
=== Successful examples (High-Performing) ===
1. "Your job description says you're looking for a manager who can grow online sales. Over the past year at 'ABC' I designed and rolled out a new social media strategy that grew sales through social channels by 45%. I'm confident my experience will help you reach your goals."
2. "I was especially drawn to your mission of creating sustainable products. On the 'Green Future' project I was responsible for sourcing suppliers of recyclable materials, which cut waste by 30%. I share your company's values and want to contribute."
=== Unsuccessful examples (Low-Performing) ===
1. "Hello, I'm interested in your manager opening. My resume is attached. I'm available for an interview at any time."
2. "I have all the necessary skills, I'm a great communicator and handle stress well. Looking for interesting work at a stable company."
**Your analysis and conclusions (principles of success):**
---
**STEP 2: REWRITE THE LETTER**
Now, using the principles you derived, rewrite the following generic cover letter excerpt.
**=== Excerpt to improve ===**
"Please consider my application for the 'Marketing Specialist' position. I have relevant work experience, as listed in my resume. I'm a fast learner and ready for new challenges."
**Your new, improved excerpt (for an opening that requires content marketing experience):**
Why This Example Works: the Mechanism.
The mechanism behind this prompt's success is the same as the previous one and rests on the key findings of the CRMAgent study:
- Task decomposition: The hard task "write a good cover letter" is split into two simpler, more concrete ones: "analyze what 'good' means" and "write following that analysis."
- Active learning: The model doesn't passively receive an instruction; it actively builds one itself from the data provided. That forces it to "understand" the task at a deeper level.
- Anchoring to reality: Instead of generic phrases ("great communicator"), the model learns to use concrete achievements and numbers, because it sees them in the "successful examples." It understands that recruiters care about verbs and results, not adjectives.
- Fewer "hallucinations": By making the model analyze first and write second, we lower the chance it generates boilerplate, irrelevant or overly "creative" text. Generation becomes more focused and purposeful.
Usefulness Rating: 94
Main Evaluation Criteria
- A. Relevance to prompting techniques: Yes, the study provides ready, structured prompts for several agents (roles) that can be adapted. It shows how to use examples (few-shot) and analysis to improve results.
- B. Better conversational answers: Yes, the whole point of the work is generating text messages that are higher quality, more persuasive and more relevant to the audience. The results tables show a significant gain in "marketing effectiveness."
- C. Direct practical applicability: Yes, a user can directly use and adapt the prompts from Figures 2, 3, 4, 5, 6. Although the study describes an automated system, its logic can be fully reproduced by hand in one LLM conversation.
- D. Conceptual value: Very high. The study introduces the concept of a "multi-agent system," which a user can emulate by giving the LLM different roles in sequence within a single prompt. It teaches breaking complex tasks into subtasks (analysis, generation, evaluation).
- E. New useful practice: The work hits several clusters at once:
- 1 (Formulation techniques): Demonstrates role-play ("You are a CRM marketing strategist"), few-shot (supplying successful and unsuccessful examples) and task decomposition.
- 3 (Structure optimization): The prompts are clearly structured with separators and headings (
=== High-Performing Templates ===). - 6 (Context and memory): Shows how to use relevant examples (a manual counterpart of RAG) to improve generation.
- 7 (Reliability and stability): Offers a self-check technique via the "EvaluateAgent," where the LLM grades the result against set criteria.
- Practicality checklist (+15 points): Yes, the study gives ready-made constructions, shows how to structure complex requests, reveals non-obvious traits (using the LLM to analyze mistakes) and offers ways to improve accuracy.
Numeric Usefulness Score
Arguments for a score of 94: This study is practically a ready-made guide to building complex, multi-stage prompts. It doesn't just give a phrase like "Think step by step"; it offers a whole reproducible methodology: analyze examples -> identify principles -> generate from those principles -> evaluate the result. The prompts in the paper are nearly ready to use "as is" after minimal adaptation. The idea of splitting the task into roles (analyst, copywriter, critic) is a hugely powerful tool for any user who wants better, more meaningful results from an LLM.
Counterarguments (why not 100):
* Focus on the system: The main subject of the study is the automated CRMAgent system, which includes components (for example, Faiss vector search) that an ordinary chat user doesn't have. The user has to mentally "adapt" the systems approach to manual execution within one conversation, which takes a little effort.
* Narrow domain: All the examples and data come from e-commerce and CRM. Although the methodology is universal, a user from another field will have to pick relevant examples for their task on their own.