Sign in

Nodes Browser

ComfyDeploy: How ComfyUI-GLHF works in ComfyUI?

What is ComfyUI-GLHF?

GLHF is a ComfyUI node that facilitates seamless interaction with the GLHF chat API. Designed to enhance user experience, it supports multiple language models, web search integration, and customizable instructions, making it a powerful extension for AI-driven workflows.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-GLHF and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI-GLHF

GLHF is a ComfyUI node that facilitates seamless interaction with the GLHF chat API. Designed to enhance user experience, it supports multiple language models, web search integration, and customizable instructions, making it a powerful extension for AI-driven workflows.

Features

Versatile Model Support

Interact with a range of language models to suit diverse use cases. Configure models via the config.json file for flexibility and control over model selection.

Integrated Web Search

Enhance your prompts with real-time information by enabling web search. The node:

  • Retrieves relevant search results.
  • Extracts content from URLs included in the prompts.
  • Appends this information to the input for more contextual and accurate outputs.

Here are examples of the web search feature in action: Web Search Example 1 Web Search Example 2

Custom Instruction Loading

Customize the behavior of the node by adding .txt files to the custom_instructions folder. This allows you to tailor the responses based on specific requirements or use cases.

Here are examples of custom instructions: Custom Instruction Example 1 Custom Instruction Example 2

Persistent Chat Context

The node maintains chat history, enabling contextual and coherent multi-turn conversations. You can enable or disable this feature through the keep_context option for tailored interactions.

Here are examples of context keeping: Context Keeping Example 1 Context Keeping Example 2

Uncensored Model

Utilize uncensored models for unrestricted creative applications. Uncensored Model Example

Console Logging

Monitor your interactions and debug effortlessly with detailed console logs that display request and response details directly in the ComfyUI console.

Getting Started

1. Get your API Key

{
  "baseurl": "https://glhf.chat/api/openai/v1",
  "api_key": "YOUR_API_KEY",
  "models": {
    "Llama3.3 70b": "hf:meta-llama/Llama-3.3-70B-Instruct",
    "QWQ 32b": "hf:Qwen/QwQ-32B-Preview",
    "Llama3.3 70b Uncensored": "hf:huihui-ai/Llama-3.3-70B-Instruct-abliterated"
  }
}

You can also add more models to the models section of the config.json file.

2. Install the Node

  • Navigate to the custom_nodes folder inside your ComfyUI directory.
  • Open a command prompt or terminal in the address bar and run the following command:
git clone https://github.com/fairy-root/ComfyUI-GLHF.git

3. Install the Requirements

  • Navigate to the ComfyUI\python_embeded folder.
  • Run the following command:
./python.exe -s -m pip install openai requests bs4 googlesearch-python

Node Parameters

The GLHF Chat with Advanced Web and Link Search node offers extensive customization through the following parameters:

  • prompt: The text prompt to send to the GLHF API.
  • seed: Random seed value for reproducible results.
  • model: The selected language model from the config.json file.
  • console_log: Toggle for console logging.
  • enable_web_search: Enable or disable web search functionality.
  • num_search_results: Specify the number of search results to include.
  • keep_context: Enable or disable conversation context maintenance.
  • custom_instruction: Choose a predefined instruction file to guide model behavior.

Custom Instructions

Custom instructions can significantly enhance the node’s flexibility. To create a new instruction:

1- Navigate to the custom_instructions folder in the ComfyUI-GLHF directory. 2- Create a .txt file, using a descriptive name for the instruction. 3- Add the desired instructions to the file.

  • Example: To create an instruction for Python-specific guidance: 1- Name the file python.txt. 2- Populate it with content such as: 
      Respond to queries as a Python expert. Provide detailed explanations and examples where applicable.
    3- The new instruction will appear in the custom_instruction dropdown menu within the node settings after restarting ComfyUI.

Donation

Your support is appreciated:

  • USDt (TRC20): TGCVbSSJbwL5nyXqMuKY839LJ5q5ygn2uS
  • BTC: 13GS1ixn2uQAmFQkte6qA5p1MQtMXre6MT
  • ETH (ERC20): 0xdbc7a7dafbb333773a5866ccf7a74da15ee654cc
  • LTC: Ldb6SDxUMEdYQQfRhSA3zi4dCUtfUdsPou

Author and Contact

License

This project is licensed under the MIT License. See the LICENSE file for details.

Contributing

Contributions are welcome! Please open an issue or submit a pull request for any improvements or features.