Stable-diffusion.prg

Harbour wrappers for stable-diffusion.cpp, which allows generating images on text description, using an AI model.

Quick review
Models to use
Compiling library
Compiling samples
Functions list
Parameters
Tests
Links

Quick review

Stable Diffusion is a deep learning text-to-image model that was initially released in August 2022. The main goal of stable-diffusion.prg project is to provide possibility to create Harbour applications, which can generate images from text prompts, using appropriate AI models. The project provides sd and ggml libraries, which may be linked to your application. Under Windows it demands 64-bit MSVC compiler, under Linux/Unix - the standard 64-bit GNU C.

Models to use

There are many models, available for generating images from text, for example:

Stable diffusion v1.4

Stable diffusion v1.5

Stable diffusion v2.1

Realistic_Vision_V6.0_B1_noVAE

Deliberate

You can find many more here or with any search engine.

Compiling library

A preferred method to build the llama library and samples is HwBuilder - my utility, which builds programs, written on Harbour. An appropriate project file, sdlib.hwprj, is provided. sdlib.hwprj and other hwprj files supposes, that there is a section for 64-bit MSVC compiler in your copy of hwbuild.ini, you need to tune it:

[C_COMPILER_6]
id=msvc64
family=msvc
...

If you prefer to not use special utilities, you can build this library with following bat file:

Windows

$echo off
if not exist lib md lib
if not exist obj md obj
if not exist obj\ggml md obj\ggml
if not exist obj\ggml\msvc64 md obj\ggml\msvc64
if not exist obj\sd md obj\sd
if not exist obj\sd\msvc64 md obj\sd\msvc64

call "c:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Auxiliary\Build\vcvarsall.bat" amd64

set CFLAGS=/TP /W3 /nologo /c /TP /W3 /nologo /EHsc /c -I./ -Iggml -Ithirdparty -Istable-diffusion.cpp -DLOG_DISABLE_LOGS=1 /W3 /WX- /diagnostics:column /O2 /Ob2 /D _MBCS /D WIN32 /D _WINDOWS /D NDEBUG /D _CRT_SECURE_NO_WARNINGS /Gm- /MD /GS /arch:AVX2 /fp:precise /Zc:wchar_t /Zc:forScope /Zc:inline /std:c11 /external:W3 /Gd /TC /errorReport:queue
set CXXFLAGS=/TP /W3 /nologo /c /TP /W3 /nologo /EHsc /c -I./ -Iggml -Ithirdparty -Istable-diffusion.cpp -DLOG_DISABLE_LOGS=1

set HB_PATH=c:\harbour
set OBJ=obj\sd\msvc64
set OBJLIST=%OBJ%\hsd.obj %OBJ%\stable-diffusion.obj %OBJ%\model.obj  %OBJ%\util.obj %OBJ%\upscaler.obj %OBJ%\zip.obj

cl.exe  %CXXFLAGS% /I%HB_PATH%\include /Fo%OBJ%\hsd.obj source\hsd.cpp
cl.exe  %CXXFLAGS% /Fo%OBJ%\stable-diffusion.obj stable-diffusion.cpp\stable-diffusion.cpp
cl.exe  %CXXFLAGS% /Fo%OBJ%\model.obj stable-diffusion.cpp\model.cpp
cl.exe  %CXXFLAGS% /Fo%OBJ%\util.obj stable-diffusion.cpp\util.cpp
cl.exe  %CXXFLAGS% /Fo%OBJ%\upscaler.obj stable-diffusion.cpp\upscaler.cpp

cl.exe %CFLAGS% /Fo%OBJ%\zip.obj thirdparty\zip.c

lib /out:lib\sd.lib %OBJLIST%

set OBJ=obj\ggml\msvc64
set OBJLIST=%OBJ%\ggml.obj %OBJ%\ggml-alloc.obj %OBJ%\ggml-backend.obj %OBJ%\ggml-quants.obj %OBJ%\ggml-aarch64.obj %OBJ%\hcommon.obj

cl.exe %CFLAGS% /Fo%OBJ%\ggml.obj ggml\ggml.c
cl.exe %CFLAGS% /Fo%OBJ%\ggml-alloc.obj ggml\ggml-alloc.c
cl.exe %CFLAGS% /Fo%OBJ%\ggml-backend.obj ggml\ggml-backend.c
cl.exe %CFLAGS% /Fo%OBJ%\ggml-quants.obj ggml\ggml-quants.c
cl.exe %CFLAGS% /Fo%OBJ%\ggml-aarch64 llama.cpp\ggml-aarch64.c
cl.exe %CFLAGS% /I%HB_PATH%\include /Fo%OBJ%\hcommon.obj source\hcommon.c

lib /out:lib\ggml.lib %OBJLIST%

Of course, you need to use your paths.

Linux

#!/bin/bash
if ! [ -e lib ]; then
   mkdir lib
   chmod a+w+r+x lib
fi
if ! [ -e obj ]; then
   mkdir obj
   chmod a+w+r+x obj
fi
if ! [ -e obj/sd ]; then
   mkdir obj/sd
   chmod a+w+r+x obj/sd
fi
if ! [ -e obj/sd/gcc ]; then
   mkdir obj/sd/gcc
   chmod a+w+r+x obj/sd/gcc
fi
if ! [ -e obj/ggml ]; then
   mkdir obj/ggml
   chmod a+w+r+x obj/ggml
fi
if ! [ -e obj/ggml/gcc ]; then
   mkdir obj/ggml/gcc
   chmod a+w+r+x obj/ggml/gcc
fi

# Set your Harbour path here
export HRB_DIR=/home/guest/apps/harbour
export CFLAGS="-c -Wall -fPIC -O3 -Wall -pthread  -march=native -mtune=native -Wno-array-bounds -Wno-format-truncation -I. -Iggml -Ithirdparty -Istable-diffusion.cpp -D_XOPEN_SOURCE=600 -D_GNU_SOURCE -DNDEBUG -DLOG_DISABLE_LOGS=1 -c -I$HRB_DIR/include"
export CXXFLAGS="-c -Wall -std=c++11 -fPIC -O3 -Wall -pthread  -march=native -mtune=native -Wno-array-bounds -Wno-format-truncation -I. -Iggml -Ithirdparty -Istable-diffusion.cpp -D_XOPEN_SOURCE=600 -D_GNU_SOURCE -DNDEBUG -DLOG_DISABLE_LOGS=1 -c -xc++ -I$HRB_DIR/include"
set OBJ=obj/sd/gcc
set OBJLIST=%OBJ%/hsd.obj %OBJ%/stable-diffusion.obj %OBJ%/model.obj  %OBJ%/util.obj %OBJ%/upscaler.obj %OBJ%/zip.obj

gcc $CXXFLAGS -o$OBJ/hsd.o source/hsd.cpp

gcc $CXXFLAGS -o$OBJ/stable-diffusion.o stable-diffusion.cpp/stable-diffusion.cpp
gcc $CXXFLAGS -o$OBJ/model.o stable-diffusion.cpp/model.cpp
gcc $CXXFLAGS -o$OBJ/util.o stable-diffusion.cpp/util.cpp
gcc $CXXFLAGS -o$OBJ/upscaler.o stable-diffusion.cpp/upscaler.cpp

gcc $CFLAGS -o$OBJ/zip.o thirdparty/zip.c

gcc $CFLAGS -o$OBJ/hcommon.o source/hcommon.c
gcc $CFLAGS -o$OBJ/ggml.o llama.cpp/ggml.c
gcc $CFLAGS -o$OBJ/ggml-alloc.o llama.cpp/ggml-alloc.c
gcc $CFLAGS -o$OBJ/ggml-backend.o llama.cpp/ggml-backend.c
gcc $CFLAGS -o$OBJ/ggml-quants.o llama.cpp/ggml-quants.c
gcc $CFLAGS -o$OBJ/ggml-aarch64.o llama.cpp/ggml-aarch64.c

ar rc lib/libllama.a $OBJLIST

ar rc lib/libggml.a $OBJ/ggml.o $OBJ/ggml-alloc.o $OBJ/ggml-backend.o $OBJ/ggml-quants.o $OBJ/ggml-aarch64.o $OBJ/hcommon.o

Compiling samples

It is better to use HwBuilder to build a sample application - test1.hwprj is provided, but you may use the following bat file:

Windows

@echo off
call "c:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Auxiliary\Build\vcvarsall.bat" amd64

set HB_PATH=c:\harbour
set HB_LIBS=gtwvt.lib hbvm.lib hbrtl.lib gtgui.lib gtwin.lib hbcpage.lib hblang.lib hbrdd.lib hbmacro.lib hbpp.lib rddntx.lib rddcdx.lib rddfpt.lib hbsix.lib hbcommon.lib hbct.lib hbcplr.lib hbpcre.lib hbzlib.lib
set SD_LIBS=sd.lib ggml.lib
set VC_LIBS=ucrt.lib user32.lib gdi32.lib comdlg32.lib shell32.lib comctl32.lib winspool.lib advapi32.lib winmm.lib ws2_32.lib iphlpapi.lib OleAut32.Lib Ole32.Lib

%HB_PATH%\bin\harbour -n -q -i%HB_PATH%\include test1.prg

cl.exe /TP /W3 /nologo /c /I%HB_PATH%\include /Fotest1.obj test1.c

link /NODEFAULTLIB:libucrt.lib /NODEFAULTLIB:msvcrt.lib /INCREMENTAL:NO /NOLOGO /SUBSYSTEM:CONSOLE /TLBID:1 /MANIFEST /MANIFESTUAC:"level='asInvoker' uiAccess='false'" /manifest:embed /DYNAMICBASE /NXCOMPAT /MACHINE:X64  /machine:x64 /LIBPATH:d:\harbour_2023\lib\win\msvc64 /LIBPATH:d:\harbour_2023\hwgui\lib\vc /LIBPATH:lib  test1.obj %HB_LIBS% %SD_LIBS% %VC_LIBS%

Linux

#!/bin/bash
# Set your Harbour path here
export HRB_DIR=/home/guest/apps/harbour

$HRB_DIR/bin/linux/gcc/harbour -n -q -i$HRB_DIR/include test1.prg
gcc -c -Wall -I$HRB_DIR/include -otest1.o test1.c
gcc  test1.o -otest1 -L$HRB_DIR/lib/linux/gcc -Llib -Wl,--start-group -lgttrm -lhbvm -lhbrtl -lgtcgi -lgttrm -lhbcpage -lhblang -lhbrdd -lhbmacro -lhbpp -lrddntx -lrddcdx -lrddfpt -lhbsix -lhbcommon -lhbct -lhbcplr -lsd -lggml -lpthread -lm -lz -lpcre -ldl -Wl,--end-group -fPIC -O3 -Wall -lstdc++ -shared-libgcc

Functions list

sd_set_params( cParams, [lAdd] ) –> nSuccess

The function sets the image generation parameters. Parameters list cParams is a string with name=value pairs, divided by ~ character:

name1=value1~name2=value2~…

See the list of parameters in appropriate section of this manual.

If lAdd is missed or is False, all parameters are set to default values before applying new.