I had it working in Solaris 11.3 but no luck with with Solaris 11.4 and Gnome 3.
# svcadm clear gdm
# svcs -Lv gdm
[ 2019 Feb 22 16:19:43 Leaving maintenance because clear requested. ]
[ 2019 Feb 22 16:19:43 Enabled. ]
[ 2019 Feb 22 16:19:43 Executing start method ("/lib/svc/method/svc-gdm start"). ]
<7>Enabling debugging
<7>Changing user:group to gdm:gdm
[ 2019 Feb 22 16:19:43 Method "start" exited with status 0. ]
<7>Successfully connected to D-Bus
<7>GdmManager: GDM starting to manage displays
<7>GdmLocalDisplayFactory: Adding display on seat /org/freedesktop/ConsoleKit/Seat1
<7>GdmLocalDisplayFactory: Reserving X display: 0
<7>GdmDisplay: id: (null)
<7>GdmDisplay: seat id: (null)
<7>GdmDisplay: session class: greeter
<7>GdmDisplay: initial: no
<7>GdmDisplay: allow timed login: yes
<7>GdmDisplay: local: yes
<7>GdmDisplay: seat id: /org/freedesktop/ConsoleKit/Seat1
<7>GdmDisplay: initial: yes
<7>GdmDisplayStore: Adding display /org/gnome/DisplayManager/Displays/52854558976 to store
<7>GdmDisplay: Managing display: /org/gnome/DisplayManager/Displays/52854558976
<7>GdmDisplay: Preparing display: /org/gnome/DisplayManager/Displays/52854558976
<7>GdmDisplayAccessFile: Creating xauth directory /tmp/gdm-auth-cookies-77dhZb
<7>GdmDisplayAccessFile: creating xauth directory /tmp/gdm-auth-cookies-77dhZb/auth-for-gdm-XXXXXX
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-77dhZb/auth-for-gdm-u0Uqsd to 50:50
<7>GdmDisplayAccessFile: creating /tmp/gdm-auth-cookies-77dhZb/auth-for-gdm-u0Uqsd/database
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-77dhZb/auth-for-gdm-u0Uqsd/database to 50:50
<7>GdmDisplayAccessFile: chmoding /tmp/gdm-auth-cookies-77dhZb/auth-for-gdm-u0Uqsd to 0711
<7>GdmDisplay: prepare display
<7>GdmLocalDisplayFactory: display status changed: 1
<7>GdmServer: Starting X server process: /usr/bin/X :0 -background none -noreset -verbose -logverbose 7 -core -auth /tmp/gdm-auth-cookies-77dhZb/auth-for-gdm-u0Uqsd/database vt7
<7>GdmServer: Opening logfile for server /var/log/gdm/:0.log
<7>GdmServer: Started X server process 3765 - waiting for READY
<7>GdmDisplay: Started X server
<7>GdmManager: Accepting XDMCP connections...
<7>GdmXdmcpDisplayFactory: Start up on host dev, port 177
<7>GdmXdmcpDisplayFactory: addrinfo family=inet6 type=datagram proto=UDP flags=passive
<7>GdmXdmcpDisplayFactory: Attempting to bind to host :: port 177
<7>GdmXdmcpDisplayFactory: Starting to listen on XDMCP port
[ 2019 Feb 22 16:19:46 Stopping because process dumped core. ]
<7>GdmServer: child (pid:3765) done (signal:6)
<7>GdmDisplay: server died with signal 6, (Abort)
<7>GdmDisplay: unmanage display
<7>GdmDisplay: Elapsed time since last start: 2.000000
<7>GdmDisplay: Number of failures=1
<7>GdmLocalDisplayFactory: display status changed: 0
[ 2019 Feb 22 16:19:46 Executing stop method ("/lib/svc/method/svc-gdm stop 226"). ]
<7>GDM finished, cleaning up...
<7>GdmDisplay: finish display
<7>GdmDisplayStore: Clearing display store
<7>GdmDisplayStore: Unreffing display: c4e609100
<7>GdmDisplay: Disposing display
<7>GdmLocalDisplayFactory: Display c4e609100 disposed
<7>GdmDisplay: Finalizing display: /org/gnome/DisplayManager/Displays/52854558976
<7>GdmDisplayAccessFile: Unlinking xauth directory /tmp/gdm-auth-cookies-77dhZb
[ 2019 Feb 22 16:19:51 Method "stop" exited with status 0. ]
[ 2019 Feb 22 16:19:51 Executing start method ("/lib/svc/method/svc-gdm start"). ]
<7>Enabling debugging
<7>Changing user:group to gdm:gdm
[ 2019 Feb 22 16:19:51 Method "start" exited with status 0. ]
<7>Successfully connected to D-Bus
<7>GdmManager: GDM starting to manage displays
<7>GdmLocalDisplayFactory: Adding display on seat /org/freedesktop/ConsoleKit/Seat1
<7>GdmLocalDisplayFactory: Reserving X display: 0
<7>GdmDisplay: id: (null)
<7>GdmDisplay: seat id: (null)
<7>GdmDisplay: session class: greeter
<7>GdmDisplay: initial: no
<7>GdmDisplay: allow timed login: yes
<7>GdmDisplay: local: yes
<7>GdmDisplay: seat id: /org/freedesktop/ConsoleKit/Seat1
<7>GdmDisplay: initial: yes
<7>GdmDisplayStore: Adding display /org/gnome/DisplayManager/Displays/42678681856 to store
<7>GdmDisplay: Managing display: /org/gnome/DisplayManager/Displays/42678681856
<7>GdmDisplay: Preparing display: /org/gnome/DisplayManager/Displays/42678681856
<7>GdmDisplayAccessFile: Creating xauth directory /tmp/gdm-auth-cookies-ErKVda
<7>GdmDisplayAccessFile: creating xauth directory /tmp/gdm-auth-cookies-ErKVda/auth-for-gdm-XXXXXX
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-ErKVda/auth-for-gdm-5LR3pb to 50:50
<7>GdmDisplayAccessFile: creating /tmp/gdm-auth-cookies-ErKVda/auth-for-gdm-5LR3pb/database
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-ErKVda/auth-for-gdm-5LR3pb/database to 50:50
<7>GdmDisplayAccessFile: chmoding /tmp/gdm-auth-cookies-ErKVda/auth-for-gdm-5LR3pb to 0711
<7>GdmDisplay: prepare display
<7>GdmLocalDisplayFactory: display status changed: 1
<7>GdmServer: Starting X server process: /usr/bin/X :0 -background none -noreset -verbose -logverbose 7 -core -auth /tmp/gdm-auth-cookies-ErKVda/auth-for-gdm-5LR3pb/database vt7
<7>GdmServer: Opening logfile for server /var/log/gdm/:0.log
<7>GdmServer: Started X server process 3813 - waiting for READY
<7>GdmDisplay: Started X server
<7>GdmManager: Accepting XDMCP connections...
<7>GdmXdmcpDisplayFactory: Start up on host dev, port 177
<7>GdmXdmcpDisplayFactory: addrinfo family=inet6 type=datagram proto=UDP flags=passive
<7>GdmXdmcpDisplayFactory: Attempting to bind to host :: port 177
<7>GdmXdmcpDisplayFactory: Starting to listen on XDMCP port
[ 2019 Feb 22 16:19:54 Stopping because process dumped core. ]
<7>GdmServer: child (pid:3813) done (signal:6)
<7>GdmDisplay: server died with signal 6, (Abort)
<7>GdmDisplay: unmanage display
<7>GdmDisplay: Elapsed time since last start: 2.000000
<7>GdmDisplay: Number of failures=1
<7>GdmLocalDisplayFactory: display status changed: 0
[ 2019 Feb 22 16:19:54 Executing stop method ("/lib/svc/method/svc-gdm stop 228"). ]
<7>GDM finished, cleaning up...
<7>GdmDisplay: finish display
<7>GdmDisplayStore: Clearing display store
<7>GdmDisplayStore: Unreffing display: 9efd90100
<7>GdmDisplay: Disposing display
<7>GdmLocalDisplayFactory: Display 9efd90100 disposed
<7>GdmDisplay: Finalizing display: /org/gnome/DisplayManager/Displays/42678681856
<7>GdmDisplayAccessFile: Unlinking xauth directory /tmp/gdm-auth-cookies-ErKVda
[ 2019 Feb 22 16:19:59 Method "stop" exited with status 0. ]
[ 2019 Feb 22 16:19:59 Executing start method ("/lib/svc/method/svc-gdm start"). ]
<7>Enabling debugging
<7>Changing user:group to gdm:gdm
[ 2019 Feb 22 16:19:59 Method "start" exited with status 0. ]
<7>Successfully connected to D-Bus
<7>GdmManager: GDM starting to manage displays
<7>GdmLocalDisplayFactory: Adding display on seat /org/freedesktop/ConsoleKit/Seat1
<7>GdmLocalDisplayFactory: Reserving X display: 0
<7>GdmDisplay: id: (null)
<7>GdmDisplay: seat id: (null)
<7>GdmDisplay: session class: greeter
<7>GdmDisplay: initial: no
<7>GdmDisplay: allow timed login: yes
<7>GdmDisplay: local: yes
<7>GdmDisplay: seat id: /org/freedesktop/ConsoleKit/Seat1
<7>GdmDisplay: initial: yes
<7>GdmDisplayStore: Adding display /org/gnome/DisplayManager/Displays/62694936832 to store
<7>GdmDisplay: Managing display: /org/gnome/DisplayManager/Displays/62694936832
<7>GdmDisplay: Preparing display: /org/gnome/DisplayManager/Displays/62694936832
<7>GdmDisplayAccessFile: Creating xauth directory /tmp/gdm-auth-cookies-GZfnRa
<7>GdmDisplayAccessFile: creating xauth directory /tmp/gdm-auth-cookies-GZfnRa/auth-for-gdm-XXXXXX
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-GZfnRa/auth-for-gdm-iCYVLc to 50:50
<7>GdmDisplayAccessFile: creating /tmp/gdm-auth-cookies-GZfnRa/auth-for-gdm-iCYVLc/database
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-GZfnRa/auth-for-gdm-iCYVLc/database to 50:50
<7>GdmDisplayAccessFile: chmoding /tmp/gdm-auth-cookies-GZfnRa/auth-for-gdm-iCYVLc to 0711
<7>GdmDisplay: prepare display
<7>GdmLocalDisplayFactory: display status changed: 1
<7>GdmServer: Starting X server process: /usr/bin/X :0 -background none -noreset -verbose -logverbose 7 -core -auth /tmp/gdm-auth-cookies-GZfnRa/auth-for-gdm-iCYVLc/database vt7
<7>GdmServer: Opening logfile for server /var/log/gdm/:0.log
<7>GdmServer: Started X server process 3861 - waiting for READY
<7>GdmDisplay: Started X server
<7>GdmManager: Accepting XDMCP connections...
<7>GdmXdmcpDisplayFactory: Start up on host dev, port 177
<7>GdmXdmcpDisplayFactory: addrinfo family=inet6 type=datagram proto=UDP flags=passive
<7>GdmXdmcpDisplayFactory: Attempting to bind to host :: port 177
<7>GdmXdmcpDisplayFactory: Starting to listen on XDMCP port
[ 2019 Feb 22 16:20:02 Stopping because process dumped core. ]
<7>GdmServer: child (pid:3861) done (signal:6)
<7>GdmDisplay: server died with signal 6, (Abort)
<7>GdmDisplay: unmanage display
<7>GdmDisplay: Elapsed time since last start: 2.000000
<7>GdmDisplay: Number of failures=1
<7>GdmLocalDisplayFactory: display status changed: 0
[ 2019 Feb 22 16:20:02 Executing stop method ("/lib/svc/method/svc-gdm stop 230"). ]
<7>GDM finished, cleaning up...
<7>GdmDisplay: finish display
<7>GdmDisplayStore: Clearing display store
<7>GdmDisplayStore: Unreffing display: e98e8d100
<7>GdmDisplay: Disposing display
<7>GdmLocalDisplayFactory: Display e98e8d100 disposed
<7>GdmDisplay: Finalizing display: /org/gnome/DisplayManager/Displays/62694936832
<7>GdmDisplayAccessFile: Unlinking xauth directory /tmp/gdm-auth-cookies-GZfnRa
[ 2019 Feb 22 16:20:07 Method "stop" exited with status 0. ]
[ 2019 Feb 22 16:20:07 Executing start method ("/lib/svc/method/svc-gdm start"). ]
<7>Enabling debugging
<7>Changing user:group to gdm:gdm
[ 2019 Feb 22 16:20:07 Method "start" exited with status 0. ]
<7>Successfully connected to D-Bus
<7>GdmManager: GDM starting to manage displays
<7>GdmLocalDisplayFactory: Adding display on seat /org/freedesktop/ConsoleKit/Seat1
<7>GdmLocalDisplayFactory: Reserving X display: 0
<7>GdmDisplay: id: (null)
<7>GdmDisplay: seat id: (null)
<7>GdmDisplay: session class: greeter
<7>GdmDisplay: initial: no
<7>GdmDisplay: allow timed login: yes
<7>GdmDisplay: local: yes
<7>GdmDisplay: seat id: /org/freedesktop/ConsoleKit/Seat1
<7>GdmDisplay: initial: yes
<7>GdmDisplayStore: Adding display /org/gnome/DisplayManager/Displays/53530956032 to store
<7>GdmDisplay: Managing display: /org/gnome/DisplayManager/Displays/53530956032
<7>GdmDisplay: Preparing display: /org/gnome/DisplayManager/Displays/53530956032
<7>GdmDisplayAccessFile: Creating xauth directory /tmp/gdm-auth-cookies-P12wDa
<7>GdmDisplayAccessFile: creating xauth directory /tmp/gdm-auth-cookies-P12wDa/auth-for-gdm-XXXXXX
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-P12wDa/auth-for-gdm-.GYVfa to 50:50
<7>GdmDisplayAccessFile: creating /tmp/gdm-auth-cookies-P12wDa/auth-for-gdm-.GYVfa/database
<7>GdmDisplayAccessFile: chowning /tmp/gdm-auth-cookies-P12wDa/auth-for-gdm-.GYVfa/database to 50:50
<7>GdmDisplayAccessFile: chmoding /tmp/gdm-auth-cookies-P12wDa/auth-for-gdm-.GYVfa to 0711
<7>GdmDisplay: prepare display
<7>GdmLocalDisplayFactory: display status changed: 1
<7>GdmServer: Starting X server process: /usr/bin/X :0 -background none -noreset -verbose -logverbose 7 -core -auth /tmp/gdm-auth-cookies-P12wDa/auth-for-gdm-.GYVfa/database vt7
<7>GdmServer: Opening logfile for server /var/log/gdm/:0.log
<7>GdmServer: Started X server process 3909 - waiting for READY
<7>GdmDisplay: Started X server
<7>GdmManager: Accepting XDMCP connections...
<7>GdmXdmcpDisplayFactory: Start up on host dev, port 177
<7>GdmXdmcpDisplayFactory: addrinfo family=inet6 type=datagram proto=UDP flags=passive
<7>GdmXdmcpDisplayFactory: Attempting to bind to host :: port 177
<7>GdmXdmcpDisplayFactory: Starting to listen on XDMCP port
[ 2019 Feb 22 16:20:09 Stopping because process dumped core. ]
<7>GdmServer: child (pid:3909) done (signal:6)
<7>GdmDisplay: server died with signal 6, (Abort)
<7>GdmDisplay: unmanage display
<7>GdmDisplay: Elapsed time since last start: 2.000000
<7>GdmDisplay: Number of failures=1
<7>GdmLocalDisplayFactory: display status changed: 0
[ 2019 Feb 22 16:20:09 Executing stop method ("/lib/svc/method/svc-gdm stop 232"). ]
<7>GDM finished, cleaning up...
<7>GdmDisplay: finish display
<7>GdmDisplayStore: Clearing display store
<7>GdmDisplayStore: Unreffing display: c76b19100
<7>GdmDisplay: Disposing display
<7>GdmLocalDisplayFactory: Display c76b19100 disposed
<7>GdmDisplay: Finalizing display: /org/gnome/DisplayManager/Displays/53530956032
<7>GdmDisplayAccessFile: Unlinking xauth directory /tmp/gdm-auth-cookies-P12wDa
[ 2019 Feb 22 16:20:14 Method "stop" exited with status 0. ]
[ 2019 Feb 22 16:20:14 Restarting too quickly, changing state to maintenance. ]
# svcs gdm
STATE STIME FMRI
maintenance 16:20:14 svc:/application/graphical-login/gdm:default
# cat ./log/Xorg.0.log
[ 86573.448] (II) dtlogin: Created display manager pipe: /var/dt/sdtlogin/0
[ 86573.454]
X.Org X Server 1.19.5
Release Date: 2017-10-12
[ 86573.454] X Protocol Version 11, Revision 0
[ 86573.455] Build Operating System: SunOS 5.11 i86pc
[ 86573.455] Current Operating System: SunOS dev 5.11 11.4.5.3.0 i86pc
[ 86573.455] Solaris ABI: 64-bit
[ 86573.455] Current version of pixman: 0.34.0
[ 86573.456] Before reporting problems, check https://support.oracle.com/
to make sure that you have the latest version.
[ 86573.456] Markers: (--) probed, (**) from config file, (==) default setting,
(++) from command line, (!!) notice, (II) informational,
(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
[ 86573.459] (==) Log file: "/var/log/Xorg.0.log", Time: Fri Feb 22 16:20:08 2019
[ 86573.460] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
[ 86573.460] (==) No Layout section. Using the first Screen section.
[ 86573.461] (==) No screen section available. Using defaults.
[ 86573.461] (**) |-->Screen "Default Screen Section" (0)
[ 86573.461] (**) | |-->Monitor "<default monitor>"
[ 86573.462] (==) No monitor specified for screen "Default Screen Section".
Using a default monitor configuration.
[ 86573.462] (==) Automatically adding devices
[ 86573.463] (==) Automatically enabling devices
[ 86573.463] (==) Not automatically adding GPU devices
[ 86573.463] (==) Max clients allowed: 256, resource mask: 0x1fffff
[ 86573.463] (==) FontPath set to:
catalogue:/etc/X11/fontpath.d
[ 86573.464] (==) ModulePath set to "/usr/lib/xorg/modules,/usr/X11/lib/modules/"
[ 86573.464] (II) The server relies on HAL to provide the list of input devices.
If no devices become available, reconfigure HAL or disable AutoAddDevices.
[ 86573.464] (II) Loader magic: 7fd330
[ 86573.465] (II) Module ABI versions:
[ 86573.465] X.Org ANSI C Emulation: 0.4
[ 86573.465] X.Org Video Driver: 23.0
[ 86573.465] X.Org XInput driver : 24.1
[ 86573.465] X.Org Server Extension : 10.0
[ 86573.474] (II) LoadModule: "glx"
[ 86573.476] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
[ 86573.481] (II) Module glx: vendor="X.Org Foundation"
[ 86573.482] compiled for 1.19.5, module version = 1.0.0
[ 86573.482] ABI class: X.Org Server Extension, version 10.0
[ 86573.482] (==) Matched vesa as autoconfigured driver 0
[ 86573.483] (==) Assigned the driver to the xf86ConfigLayout
[ 86573.483] (II) LoadModule: "vesa"
[ 86573.484] (II) Loading /usr/lib/xorg/modules/drivers/vesa_drv.so
[ 86573.485] (II) Module vesa: vendor="X.Org Foundation"
[ 86573.485] compiled for 1.19.5, module version = 2.3.4
[ 86573.485] Module class: X.Org Video Driver
[ 86573.486] ABI class: X.Org Video Driver, version 23.0
[ 86573.486] (II) VESA: driver for VESA chipsets: vesa
[ 86573.487] (--) VT infrastructure is not available
[ 86573.487] (EE)
Fatal server error:
[ 86573.488] (EE) xf86OpenConsole: Cannot open /dev/fb (No such file or directory)
[ 86573.488] (EE)
[ 86573.489] (EE)
Please consult the Oracle Corporation, based on X.Org Foundation sources support
at https://support.oracle.com/
for help.
[ 86573.490] (EE) Please also check the log file at "/var/log/Xorg.0.log" for additional information.
[ 86573.490] (EE)
[ 86573.491] (EE) Server terminated with error (1). Closing log file.
# mdb /core
Loading modules: [ Xorg libc.so.1 ld.so.1 ]
Xorg:core> ::status
debugging core file of Xorg (64-bit) from dev
file: /usr/bin/Xorg
initial argv:
/usr/bin/Xorg :0 -depth 24 -nolisten tcp -background none -noreset -verbose -lo
threading model: raw lwps
status: process terminated by SIGABRT (Abort), pid=3909 uid=0 code=-1
Xorg:core>
Xorg:core> ::stack
libc.so.1`__lwp_sigqueue+0xa()
libc.so.1`raise+0x19()
libc.so.1`abort+0xd1()
OsAbort+0x1b()
FreeAuditTimer()
FatalError+0x125()
xf86OpenConsole+0x5a8()
InitOutput+0x6c3()
dix_main+0x468()
0x4cf124()
Xorg:core>
Any ideas.